The Chiefs were founded in 1996 in time for the inaugural season of the Super 12 (which is now known as Super Rugby). Although the team was competitive immediately, they struggled to make much of an impact in the competition. In fact, the Chiefs Rugby team did not reach the knockout phase of the tournament until the 2004 season, when they finished fourth and then lost to the Brumbies in the semi-final. The team then returned to mediocrity before they made their first-ever final in 2009. However, they were beaten by the Bulls.

Finally, the team made a breakthrough in the 2012 season when they finished at the top of the league standings before beating the Sharks in the final. The next season, the team’s good run of form continued and they clinched back-to-back titles when they beat the Brumbies. These remain the only two titles in the history of Chiefs Rugby. However, the side have qualified for the knockout phase of Super Rugby in every season since their 2013 triumph.

In recent years, the Chiefs Rugby team have also taken on a couple of touring international sides. In 2016, they comprehensively beat a touring Wales side 40-7 and became the first New Zealand Super Rugby franchise to defeat an international team. A year later, they were beaten 34-6 by a touring British and Irish Lions team in Hamilton.