I don't think that fossil fuel is the only way to bootstrap up to a high-energy, high-complexity civilization. Hydroelectric generation also yields the sort of dependable, concentrated energy source you need for industrial development, and it was first built with 19th century technology. The necessary 19th century precursor technologies (steel, concrete, wire...) could be manufactured with wood instead of coal. Reservoir-backed hydroelectric dams can also serve, effectively, as a giant battery when you start trying to introduce more abundant but less steady energy sources like wind and solar.
The global potential of energy from hydroelectricity is only a small fraction of our current fossil-based consumption, though. And while wind and solar have potential resources far past fossil power, they can't expand as fast as fossils did historically. So the Fermi Paradox aspect might be that civilizations without fossils and without the self-control to limit reproduction are hobbled by cycles of Malthusian collapse. Or perhaps space-capable civilizations that didn't fall into the Malthusian boom-bust trap while still confined to one planet also don't go crazy with growth once they escape their gravity well, so they're out there but not leaving evidence dramatic enough to be seen by our current telescopes.
If you just mean that it's impractical to build the electrical grid out to a remote mining site, that's true. In the present day remote mining sites typically use diesel fueled generators, now being supplemented with photovoltaic arrays in sunny regions. If you imagine a world with approximately-1940-level technology (so PV is not yet an option) and no fossil fuel, then you'd need to use something like biodiesel or ethanol instead of fossil-derived diesel.
> If you just mean that it's impractical to build the electrical grid out to a remote mining site
Yes, that was the general issue. We do a lot of mining in remote sites that don't have hydro power or any realistic way to get it there. You could use biofuels, but it's hard to imagine bootstrapping a technical society to the point that that becomes feasible without prior use of fossil fuels.
If you have a suitable river not too far away you actually can mine using hydromechanical power. [1] Turning it into electricity loses a lot, but transmission is of course easier
The global potential of energy from hydroelectricity is only a small fraction of our current fossil-based consumption, though. And while wind and solar have potential resources far past fossil power, they can't expand as fast as fossils did historically. So the Fermi Paradox aspect might be that civilizations without fossils and without the self-control to limit reproduction are hobbled by cycles of Malthusian collapse. Or perhaps space-capable civilizations that didn't fall into the Malthusian boom-bust trap while still confined to one planet also don't go crazy with growth once they escape their gravity well, so they're out there but not leaving evidence dramatic enough to be seen by our current telescopes.