The yen rallied to a 14-year high against the dollar on Thursday amid speculation Japan's monetary authorities will tolerate further appreciation of the currency.

Finance Minister Hirohisa Fujii said Thursday the government needs to take action on "abnormal" currency movements.

Earlier, Vice Finance Minister Yoshihiko Noda reportedly said the government isn't considering stepping into the currency market.