i think it is good to go fishing whenever you can.and it can be as good midday as any time of the day.alot depends on the time of year and weather.if it is sunny and no wind than it can be tough,but fish can be caught and most times you will need to slow way down and fish plastics or jigs and fish real close to cover.if the bite is real slow try throwing smaller lures like a shakeyhead or dropshot.if you are good at fishing offshore structure than deepdiving crankbait,carolina rig or big spinnerbait can really pay off during the summer.if it is cloudy and/or windy than the fish could be as active midday as anytime.in this situation i would try windblown points with crankbaits and spinnerbaits,also try windblown flats with crankbaits,spinnerbaits and rattlebaits.
just because its midday doesnt mean you cant catch fish,just dont get frustrated when the bite slows.just fish closer to cover or move out deeper til you find the were the fish have moved to.