This calm evocation of a fishing scene consists of a small fishing boat in the foreground to the left. There are two seated figures and one standing in the boat, preoccupied as they look over the side towards their fishing line in the water. In the foreground, on the stone quay, the artist has created a still life with a single shoe, red jacket, small wooden mallet and a tool with a lead weight on a line. The water is flat calm and the pronounced reflections form strong shapes on the water. To the right several hay barges are at anchor, and on the far right sheep are at the water's edge. The hills rising up to the right, and in the distance, serve to frame the composition. The building and trees to the left may belong to Nash House, and the sails of small ships imply a harbour beyond.

The artist produced several versions of this painting. Although its title identifies it as Cowes Castle, the scene is not topographically accurate since steep hills have been depicted rising from the water's edge on the mainland side. The scene is, rather, intended to evoke an English landscape in an Italianate manner, and is a composite incorporating various elements in one image. Callcott and his wife visited Italy following their honeymoon in 1827.

In the same year, the artist submitted a painting with the above title to the Royal Academy. This painting may be a small version of the picture which was owned by Lord Egremont at Petworth. J. M. W. Turner also painted Cowes Castle during 1827, and there was some rivalry between the two artists since Lord Egremont was one of Turner's patrons. The work was exhibited at the Old Masters' Exhibition at the Royal Academy in 1875 when it was owned by Lord Egremont. Later, when it was acquired by Frederick Nettlefold, it assumed the title 'Fishing Scene'.