Congress struggles to maintain support, winning sometimes but failing to retain it in subsequent elections