Bacterial and fungal communities play significant roles in waste biodegradation and nutrient reservation during composting. Biochar and zeolite were widely reported to directly or indirectly promote microbial growth. Therefore, the effects of zeolite and biochar on the abundance and structure of bacterial and fungal communities and their shaping factors during the composting of agricultural waste were studied. Four treatments were carried out as follows: Run A as the control without any addition, Run B with zeolite (5%), Run C with biochar (5%), and Run D with zeolite (5%) and biochar (5%), respectively. The bacterial and fungal community structures were detected by high-throughput sequencing. Redundancy analysis was used for determining the relationship between community structure and physico-chemical parameters. The results indicated that the addition of biochar and zeolite changed the physico-chemical parameters (e.g., pile temperature, pH, total organic matter, ammonium, nitrate, and water-soluble carbon) during the composting process. Zeolite and biochar significantly changed the structure and diversity of bacterial and fungal populations. Moreover, the bacterial community rather than the fungal community was sensitive to the biochar and zeolite addition during the composting process. Community phylogenetic characteristics showed that Nocardiopsaceae, Bacillaceae, Leuconostocaceae, Phyllobacteriaceae, and Xanthomonadaceae were the predominant bacterial species at the family-level. Chaetomiaceae and Trichocomaceae were the two most dominant fungal species. The pH, total organic matter, and nitrate were the most important factors affecting the bacterial and fungal population changes during the composting process.