Inflation statistics are available from the Bureau of Labor Statistics, a part of the US Department of Labor.
The Consumer Price Index for All Urban Consumers is the most widely used inflation statistic. It can be found here.
A list of the wide variety of statistical tables available can be found here. You can get more data than you could ever use.