Japan’s economy minister said he submitted his resignation on Monday over ties to the Unification Church after facing mounting criticism in a widening controversy involving dozens of governing party lawmakers.

Daishiro Yamagiwa’s resignation is a further blow to Prime Minister Fumio Kishida’s government, which has been rocked by his party's close ties to the controversial South Korean-based church following the assassination of former leader Shinzo Abe in July.

The Kishida government's support ratings have nosedived over his handling of the scandal and for holding a highly unusual state funeral for Abe, one of Japan’s most divisive leaders who is now seen as a key link between the governing Liberal Democratic Party and the church.

Since the 1980s, the church has faced accusations of devious business and recruitment tactics, including brainwashing members into turning over huge portions of their salaries to it.

Kishida shuffled his Cabinet in August to purge seven ministers who had acknowledged ties to the church. Yamagiwa was retained as economic minister, but opposition lawmakers stepped up demands for his resignation after he repeatedly said he did not remember his past attendance at church meetings during overseas trips and posing for group photos with church leader Han Hak Ja Moon and other executives.

“I just submitted my resignation" to Kishida, Yamagiwa told reporters. He said he routinely discards documents and therefore could not clearly verify past contacts with the church and only provided explanations after reports of his past church ties surfaced.

“As a result, I ended up causing trouble to the administration,” Yamagiwa said. “I attended the church's meetings a number of times and that provided credibility to the group, and I deeply regret that." He pledged to stay away from the church in the future.

A governing party survey in September found nearly half of its lawmakers had ties to the church, including Cabinet ministers. Kishida has pledged to cut all such ties, and recently said he instructed the government to probe the church, with the possibility of revoking its legal status. Media surveys show many Japanese want a clearer explanation of how the church may have influenced party policies.

Kishida said he accepted Yamagiwa's resignation because “as prime minister, I have to prioritize our work to push forward economic measures, an extra budget and support for victims of the church problems.”

Yamagiwa, who was criticized for clinging to his post and stalling parliamentary sessions because of questioning by opposition lawmakers, was seen as having been forced to quit. He said he has no intention of resigning as a lawmaker because he did not break any law.

Kishida said he will announce Yamagiwa's successor on Tuesday.

Former Prime Minister Abe was shot to death during an outdoor campaign speech in July. The suspect, Tetsuya Yamagami, told police he killed Abe because of his apparent link to a religious group he hated. A letter and social media postings attributed to Yamagami said his mother’s large donations to the Unification Church bankrupted his family and ruined his life.

The church, founded in South Korea in 1954 by Sun Myung Moon, obtained religious organization status in Japan in 1968 amid an anti-communist movement supported by Abe’s grandfather, former Prime Minister Nobusuke Kishi.

The group acknowledged there have been cases in which it received “excessive” donations. It says the problems have been mitigated since it adopted stricter compliance measures in 2009 and has pledged further reforms.

The police investigation of Abe’s killing led to revelations of widespread ties between the church and members of the governing party, including Abe, over their shared interests in conservative causes. The case also shed light on the suffering of adherents’ relatives, some of whom say they were forced to join the church or were left in poverty or neglected because of their parents’ devotion.

Many critics consider the church to be a cult because of problems with followers and their families, including financial and mental hardships.