The 1950-51 season proved to be a tough one for Charlton. They had a poor campaign in the league, finishing off the season in a disappointing 17th position, just avoiding relegation. They were poor in the FA Cup, crashing out in the third round of the competition, losing 3-0 against Blackpool. The Addicks steadily improved the following year and as the 1951-52 season wore on, the Addicks found themselves finishing in the top half of the table. For the second consecutive season they finished off in the third round of the FA Cup, this occasion losing against Luton Town 1-0. The 1953 and 1954 FA Cup’s were unsuccessful for the Addicks as they became familiar with the third round exit, losing against Hull City and Portsmouth respectively. They were a force in the top flight during the 1952-53 campaign, finishing the season off in a very impressive fifth place.
The 1954-55 season witnessed the Addicks reach the fifth round of the FA Cup, stumbling out against Wolves, suffering a humiliating 4-1 thrashing against the Midlands club. They gradually slid down in the top flight, finishing off the season in 15th place.
Athletic could not improve during the 1955-56 season and they could only manage a disappointing 14th place finish. They once again reached the fifth round of the FA Cup, this time losing 2-0 against Arsenal. Jimmy Seed left the managerial post at the end of the 55-56 season and Jimmy Trotter took charge from there on.
The Addicks could not respond well to Trotters appointment and they struggled for the entire 1956-57 season and embarrassed them selves to a 22nd place finish, rock bottom of the first division, in turn relegating the club to the second tier of English football. They did not appear in the top flight again until the end of 1987, so it started off a 30 year absence.
Trotter saw a huge improvement in Charlton’s performances during the 1957-58 seasons; however they finished the season off in 3rd place, narrowly missing automatic promotion back into the top flight. For the remainder of the 1950’s they occupied the top eight of the second division; however they could not gain the required promotion.