Rod Dibble put me onto the starter kit that comes with joining the Fly Dressers Guild:
The Fly Dressers Guild
I've only been at it a few months so no expert (don't mention that word) - my experiences so far with the kit:
The vice is not great but when you start it hardly matters and to be honest, it wouldn’t make a great difference to my output still if I went back to using it - it is nice to use a full rotary vice though, as makes life easier.
The old one sits on the end of my desk and I put my most pleasing attempts in it, leave them on display for the kids to have a look at when they come in my computer room for a while before they go into the box.
The tools are OK - you'll probably want to replace the whip finisher and scissors pretty quickly though as I did, although the old scissors can be used for cutting things that you don't want to blunt pricier ones on.
Other than that, a good place to start, as various bits of tying materials are included, there is a good starter book included that is really clear to read and follow, which helps in adding to your skills.
You also get the newsletter and membership of the guild of course.
Won't mention how much I have now spent on tying kit now I've got going though
Good source of Hooks and other bits and bobs is from Phil Holding (Fly Tying Boutique) - there are many other good suppliers of course!