The former official said the contrast between a hawkish Federal Reserve and the Bank of Japan's loose monetary policy remains the single biggest driver of the yen's weakness.