IANAL, but it seems to me that there would be a strong ADA/accessibility defense for youtube-dl as a user agent.

The other major defense is that it’s a tool with significant lawful use.

Many digital tools can be used to infringe. It’s only a problem for the tool maker if the tool’s primary purpose is circumventing copyright.