This can be very frustrating... as I am sure you've found out. Are you on river or still water?
There can be lots of reasons for it happening. It's worth trying a few tactics.
Often when they are feeding like this, I find it is because they are either taking subsurface food (but right beneath the surface) or very small flies. Sometime small black gnats, or possibly terrestrials (lots of flying ants at the moment!).
You say you've tried different sizes... but which? My suggestion would be to go for smallish pattern that site right in the surface film - with as little foorprint as possible. Try this in a #20 or even a #24:
River Fly Box, tying a simple CDC Shuttlcock
May also be worth trying a small spider. Lighlty greased it will lie in the surface and has been a get out of jail for regularly. If it sinks, just wathc the leader - f it draws away or twitches ~ strike.
or conversly... offer them somthing big (perhaps a #14 or #12 Klinhamer). It may not match the hatch, but sometimes stirs them into hitting the fly.
On occasions fish will splash to drown a fly. It happens, but is unusual. My suggestion is this is worth forgetting at the moment and concentrate on the above.
Try looking at what is on the water - if you're on the river, then get in the flow and watch what is flowing past your - look at the water immediately next to / infront of you.
If you're finding this on stillwater, try a large bouyant dry on the point and a spider on the dropper(s). Fish will often take the spider as it is in the top few inches. You'll either see the fish rise between your line and the point fly, or the point fly will drag / disappear.
If this still doesn't work, pack up and grab a beer instead