Check this video:
Dylan: You asshole. You hit her. That's the thing I was pissed off about. I wasn’t pissed off at—about the flick. Do you remember what you said to me when I played you those tapes?
Lennon: No. What?
Dylan: I'll say it later. I was just gonna say it.
Lennon: Well say it now!
Dylan: Oh, remember you said to me... I played you a song and you said, something about, "That's gotta be in..." I didn't realize it at the time. Robbie told me. You said that it's gotta be in your song publishing company! What's the name of it? What's your, you know, your song publishing company?
Lennon: Oh, the song publishing company!
Dylan: Yeah, what is the name of it?
Lennon: Dick James.
Dylan: No, no... Is that the name of it?
Dylan: Dick James... That wasn't the name I heard.
Lennon: Northern Songs?
Dylan: Right, that was it. "That oughta be in Northern Songs." I said, "What's Northern Songs?" And then I was never told and I had to go out and find out.
Lennon: Didn't we tell ya?
Dylan: No, man. You didn't tell me. You said, "This oughta be in Northern Songs." You laughed and Paul McCartney looked the other way talking to Ringo...
Lennon: ...and Mick Jagger looked up and balloon dropped out of his face.
Dylan: Mick Jagger looked up and then shit through his nose.
I found this thread while looking for the exact quote of Al Kooper’s first testimony I read about the subject, which appeared in MOJO magazine (issue 60, November 1998). Couldn’t find exactly that one but a reference to it and the video in this discussion, which altogether show that Kooper’s recollection varies from time to time, so one might suspect he’s also adding something to the story. The quote I couldn’t find was in the terms of: “-Bob, ain’t that song very similar to NW? -No way! It’s their song that’s too like mine!”. Somewhere else I found: “Kooper said he was worried the Beatles might sue Dylan. Dylan said NW was his song in the first place, so a lawsuit was out of the question."
This is gonna be wordy but, to explain the circumstances of the video I posted: Lennon and Dylan are taking a cab ride in London, 1966, with Bob Neuwirth and D A Pennebaker (who’s filming). Among a lot of gibberish, Dylan tries to confront Lennon about something: he has at some point shown the Fab4 some tapes, one song in particular, to which Lennon has commented, half joking, that it should be in Northern Songs, their publishing company. Dylan says he didn’t understand it at the time but that Robbie (Robertson, of The Band, then still called The Hawks) explained/showed it to him. In short, he’s complaining that he’s shown the guys some tapes and that they’ve ripped him off (of one song in particular). Unfortunately, Lennon seems to understand what Bob’s aiming at, realizes he’s on camera, and jokes himself out of the discussion.
This doesn’t prove Dylan’s talking about 4th Time Around but he possibility has been mentioned of Bob playing the song live for the Beatles. Here we see that Bob did show material for the guys, he played them tapes. And the whole context makes sense. Bob shows the Beatles the recordings, Rubber Soul comes out (December 3, 1965), with Norwegian Wood, Dylan records 4th Time Around (February 66) for he’s apparently pissed because of Norwegian Wood. The cab ride must’ve taken place late May 66, around Dylan’s concerts at the Albert Hall (26 and 27 May). Bob tries to ask for an explanation, but he’s not mad about it.
Dylan showed and sent recordings away for other people to record all the time, even after this incident. The whole story of the Basement Tapes is there to show. It is even possible that hearing Norwegian Wood might have spurred him to record the song. The sad part is, when Blonde on Blonde is finally released (on June 20, 1966), 4th Time Around is generally received and perceived as Bob’s RESPONSE to Norwegian Wood. Could get pissed for less.