Fiber reinforcement is an important method to enhance the performance of concrete. In this study, the compressive test and impact test were conducted, and then the hybrid effect between steel fiber (SF) and carbon fiber (CF) was evaluated by employing the hybrid effect index. Compressive toughness and impact toughness of steel fiber reinforced concrete (SFRC), carbon fiber reinforced concrete (CFRC) and hybrid fiber reinforced concrete (HFRC) were explored at steel fiber volume fraction 0.5%, 1%, 1.5% and carbon fiber 0.1%, 0.2%, 0.3%. Results showed that the addition of steel fiber and carbon fiber can increase the compressive strength. SF, CF and the hybridization between them could increase the compressive toughness significantly. The impact test results showed that as the volume of fiber increased, the impact number of the first visible crack and the ultimate failure also increased. The improvement of toughness mainly lay in improving the crack resistance after the first crack. Based on the test results, the positive hybrid effect of steel fiber and carbon fiber existed in hybrid fiber reinforced concrete. The relationship between the compressive toughness and impact toughness was also explored.