The growing demand for flexible, high-quality fabrication of free-form micro-optics drives the development of laser-based fabrication techniques for both the shape formation and surface polishing of optical elements. In this paper, we performed a thorough and systematic study on fused silica glass ablation using 10 ps and 320 fs duration pulses. Ablation processes for both pulse durations were optimized based on the measurements of the removed material layer thickness and surface roughness, and by analyzing the topographies of ablated cavities to remove material layers as thin as possible with minimum surface damage. Our findings demonstrate higher process resolution and surface quality for femtosecond pulses. Ablation of pre-roughened glass reduced the minimal removable glass layer thickness well below the 1 μm mark for both pulse durations, improving the process resolution. The minimal removable glass layer thickness was 14 times smaller for the femtosecond pulses, with up to 4.5 times lower surface roughness compared to samples processed with picosecond pulses. On the other hand, results revealed faster glass removal rates with picosecond pulses. In the end, arrays of microlenses were fabricated with both pulse durations and subsequently polished with a CO2 laser. Results revealed higher performance of microlenses fabricated with femtosecond pulses, providing better focusing capabilities and lesser beam scattering. Finally, this study demonstrated the successful fabrication of free-form optical elements with femtosecond and picosecond pulses, demonstrating the versatility and the potential of laser-based techniques.