This paper presents a complete system for autonomous navigation in GPS-denied environments using a minimal sensor suite that operates onboard a robotic vehicle. Our system utilizes a single camera and, given a target destination without prior knowledge of the environment, replans in real time to generate a collision-free trajectory that avoids static and dynamic obstacles. To achieve this, we introduce, for the first time, a local Euclidean Signed Distance Field (ESDF) map with variable size and resolution, which scales as a function of the vehicle’s velocity. The map is updated at a high rate, requiring minimal computational power. Additionally, a short-term vicinity-based memory is maintained for previously observed areas to facilitate smooth trajectory generation, addressing the limited field-of-view provided by the RGB-D camera. System validation is carried out by deploying our algorithm on a differential drive vehicle in both simulation and real-world experiments involving static and dynamic obstacles. We benchmark our robotic system against state-of-the-art autonomous navigation frameworks, successfully navigating to designated target locations while avoiding obstacles in both static and dynamic scenarios, all without introducing additional computational overhead. Our approach consistently achieves the target goals even in complex settings where current state-of-the-art methods may fall short.