"A lot of good work is going on out there, but it's not very coordinated," Rudd told reporters and energy industry executives.
"What we are trying to do is bring it together, not just to make Australia the go-to place for this critical technology for the future, but also to make a real difference," he said.
Australia is the world's top coal exporter and 16th-biggest carbon polluter, producing about 1.5 percent of global emissions. But the country is the fourth-largest emitter per person, relying heavily upon coal-fired electricity for energy.
The institute, Rudd said, would be tasked with helping reach a goal set in Japan by the G8 group of rich nations recently of having 20 industrial-scale carbon-sequestering coal-fired power plants running by 2020.
So-called geo-sequestration of carbon, in which carbon dioxide is liquefied and pumped into underground rock layers for long-term storage, could account for 20 percent of global mitigation efforts by 2050, he said.
Environment watchdog Greenpeace said the centre-left government was focusing on the "false hope" of carbon capture and storage to protect the coal industry, while shunning proven renewable technologies like wind, solar and geothermal energy.
"Clean, sustainable solutions to climate change already exist," Greenpeace climate and energy campaigner Simon Roz said.