The new secretary of state met with his counterparts from Australia, India, and Japan after being sworn in Tuesday.