House of Representatives Speaker Yohei Kono indirectly urged Prime Minister Junichiro Koizumi on Tuesday to stop visiting Yasukuni Shrine, Liberal Democratic Party lawmakers said.