12.9% of the energy use in the EU originates from the commercial and public sector. It has therefore become a priority to optimize energy efficiency in these buildings. The purpose of this study has been to explore how energy demand in a new office building is affected by different internal heat gains, location, orientation, and façade design, and also to see how different indicators can change perspective on energy efficiency. The study was performed with simulations in IDA-ICE with different façade design and changes in internal heat gains (IHG), orientation, and location. Energy demand was then compared to two different indicators. Using a façade designed to lower solar heat gains had little effect on energy demand in the north of Sweden, but slightly more effect further south. The amount of internal heat gains had significant effect on energy demand. Making deeper studies on design and internal heat gains should therefore be prioritized in the beginning of new building projects so the most energy-efficient design can be chosen. When the indicator kWh/m² was used, the cases with low internal heat gains were perceived as the most energy efficient, while when kWh/(m² × hpers) (hpers = hours of use) was used, the cases with high occupancy and low electricity use were considered to be the most energy efficient. Therefore, revising the standardized indicator is of great importance.