Cinema legend loves the rise of a film-school rookie with a camera, a megaphone and a maxed-out credit card, but that is not Lenny Abrahamson's story. When he made his 2004 debut, Adam and Paul, he was already in his late 30s, with an abandoned PhD in philosophy and a career in commercials behind him. "I'm a bit of a late developer generally," he sighs. "But the good thing about being a filmmaker is you still count as young all the way through your 40s." He is 46 now, with wispy red hair and soft eyes, and so modest that he squirms visibly when I ask him to pinpoint his place in Irish cinema. "All the taxi drivers in Dublin have heard of Neil Jordan and Jim Sheridan. I guess I'm the next one down."
Three films into his career, he has already established a recognisable sensibility (dryly funny, inquisitive, plangent) and been honoured with a retrospective at the Irish Film Institute. Nigel Andrews of the Financial Times observed that Abrahamson and his regular collaborator Mark O'Halloran "may be the best thing that ever happened to Irish cinema". O'Halloran, who wrote and starred in Adam and Paul, and scripted the director's second film, Garage, says of his friend: "He's enormously respected in Ireland. All the films have done brilliantly at the box office, which is unusual: they're arthouse films, there's no two ways about it, and yet they strike a chord. It's hard to elbow your way into the Cineplex world, but Len has done it: he puts bums on seats." Those taxi drivers had better get on the case, and fast.
I meet the director one crisp afternoon in a hotel in his native Dublin. The corridors are filled with the hubbub of a spiffy wedding party, while outside 10,000 protesters are taking part in an anti-austerity march. It's a division to which Abrahamson's work is alert. He has until now been a poet of the dispossessed. Adam and Paul was a grungy comic odyssey about 24 hours in the lives of two homeless Dublin smackheads: it was Ulysses meets Waiting for Godot with Laurel and Hardy pratfalls. Garage was a melancholy character study about a jovial attendant at a rundown rural petrol station, whose developmental difficulties prevent him from seeing that his entire way of life is doomed.
Abrahamson's haunting new picture, What Richard Did, retains the confidence and control of its predecessors, but the 18-year-old hero (played by Jack Reynor, recently announced as the lead in the next Transformers movie) could hardly be less of an outsider. He's handsome, respected, comfortably middle-class, larky with his rugby team-mates and tender toward his girlfriend. But a sense of foreboding permeates the film from the opening seconds when Richard mutters innocuously: "Somebody's got a problem." That somebody is him. Prospective viewers unfamiliar with the source material (Kevin Power's factually-based novel Bad Day in Blackrock) will by this point be asking: what did he do? Let's preserve the mystery and say only that what Richard did falls outside the category of jolly japes.
"Generally speaking, the misfit's story is easier to tell," Abrahamson says. "I've done it myself – twice. Richard is a good guy, but good guys are complex, too. I was thinking about those boys and the pressure they're under, their inability to deal with fractures in that perfect sphere of life. It's the kind of situation we all know, where we disappoint ourselves, and we have to deal with the disjunction between what we would like to be and what we are. I was interested in the narrative of how we nurture our elite in this society: all that stuff about believing in yourself and not accepting second best. Our inner world is at odds with that. What's fascinating about a boy of Richard's age is that he still believes his own bullshit. If you meet an adult who believes his own schtick to that extent, you're talking about someone like Simon Cowell – you know, a monster. But at 18 or 19, it's naively-held and it can be attractive."
The picture is characterised by subtly disorienting ellipses and stylistic tensions. Sometimes the cinematography is as pretty as Terrence Malick at magic hour; elsewhere, the actors are stalked by a predatory steadicam. Through it all, Abrahamson's curiosity about his subjects is palpable. "I like to feel that the implied director of the film is a slightly academic, tweedy figure. He's scratching his chin, asking: 'What is this person doing? Let me get in a little closer.' I pitched it as a kind of natural history project where I take this tribe and see if I can understand what's going on with them." That said, What Richard Did takes place much more in Abrahamson's own world than either of his previous films. As a privately-educated, middle-class filmmaker, he has experienced different sorts of class hostility. "Occasionally you get people saying: 'Who'd want to watch something about these privileged kids?' And with Adam and Paul, you'd sometimes hear: 'Who the hell does he think he is, making a film about homeless drug addicts?' But I live in this country: I can talk about anything I like in my work. I feel very bullish about that."
If Abrahamson speaks eloquently about the insecurities that plague Richard, it may be because he has experienced his own. He made a splash in his early 20s with several short films before sidelining his career to accept a scholarship to Stanford to study philosophy. "As soon as I got there, I felt really unsure. I loved the subject but I felt lonely, and I was aching to do something in film. Then once I was back in Dublin six months later, I thought: 'What have I chucked away?'" He began rising later and later each day until he found he was sitting at his typewriter through the night. "It was this weird nocturnal existence. I was miserable and I was producing nothing I liked." An escape route came through directing commercials: his witty, glossy lager ads depicting male fantasy worlds (the "Carlsberg doesn't do …" series) were something of a phenomenon. "It was a chance for me to test whether I could pull off this filmmaking thing after all." He could. It marked one of the few occasions anyone's professional prospects had been improved by alcohol.
Even once Adam and Paul was made –for half the budget of one of those 60-second lager ads – there was a brief period of uncertainty for Abrahamson. "I remember a Q&A I did in Wales where there were five people in the auditorium. One guy who was really pissed came up on stage halfway through to give me a big hug." He laughs. "So my hopes weren't high." But Adam and Paul caught on: the reviews were glowing, the Withnail and I comparisons richly deserved, the humour scabrous and poignant. "There was a tone in Adam and Paul that I was trying to get toward," says O'Halloran. "Len understood it and knew exactly what to do with it: he encouraged me to go further. I was really lucky to meet him."
This month, Abrahamson begins shooting another comedy: Frank, his most ambitious project yet. Set partly at the SXSW festival (with Albuquerque standing in for Austin), it will star Michael Fassbender as an enigmatic, agoraphobic musician who rarely emerges from beneath his giant fake head. That detail is inspired by the eccentric Mancunian performer Frank Sidebottom – the film is co-written by the Guardian's Jon Ronson, a former member of Sidebottom's band – but Abrahamson insists the character stands in for all music's outsiders.
Peruse the film's potentially volatile ingredients (rock'n'roll comedy, European director working for the first time in America) and you would be forgiven for thinking: "Uh-oh – This Must Be the Place." But fear not. Abrahamson is a devout minimalist who has yet to direct a film that's over 90 minutes long. "I always think I want to make something at the other end of the spectrum. Not quite Almodóvar, but maybe slightly extravagant. Then I end up doing the minimalism thing. I'm looking for an intensity of focus. It's a bit like tuning a guitar string. You tighten and tighten and nothing really changes until you hit that tension and suddenly it's there: you've got a note."
What Richard Did opens in the UK on 11 January.