Hi Graham, to begin with, you will need a vice, as a first vice I would go with the snowbee fly mate, they have great reviews and have the features of a vice £150 more expensive (rotary function e.t.c) they only cost £35 - £50 (I think) I am borrowing a vice for now, but if I can I will try to buy one of these myself.
I have only been Fly Tying for about 4 or 5 weeks, and haven't got hundreds of different tools or materials, the basics with do for a few hundred flies for sure
The only tools that I have are, scissors (Dr slick, one of the best makes of tools), Ceramic bobbin holder, dubbing needle, half hitch tool you could use a whip finisher if preferred), hackle pliers, dubbing brush (lolly pop stick with velcro stuck on), wax, and a dubbing twister if you prefer dubbing loops, but it doesn't really matter.
For materials, Veniards seems to be the biggest supplier, but I may be wrong, the only places I have been to look at materials are online. But the best thing to do is go to a shop and speak to people who have been fly tying for years, that is the best way of getting information.
Here are a few websites that are very good for fly tying tools/materials
Fly-tying materials and fly tying tools and accessories - Lakeland Fly-Tying
Fly Tying Materials, Fly Tying Equipment, Fly Fishing, Fly Tying – Fly Tying Boutique
Fly Fishing Tackle, Fly Tying Tools & Materials for Trout & Salmon
Sportfish - Fly Fishing Tackle and Fly Fishing Equipment
Fly Fishing Tackle, Fishing Equipment, Fishing Waders, Fly Reels, Mail Order Fishing Tackle | Fishtec
Fly Tying Materials from Funky Fly Tying
Hope this helps, if I think of or find any other websites I will post them on this thread
Of course NEVER say no to anything that people may want to send you (I'm afraid I haven't got anything to offer as I have just started fly tying myself

) And the classifieds section of this forum is brilliant too, always something to found there for a very good price