Opensource WebCrawler c# library

Based on a C# opensource WebCrawler, but was not comfortable with how it work and what was reported, but had many essentials I had in a previously built webcrawler I lost.

This webcrawler has been customised for my need to locate pages having a 404 not found links, not just that a link is dead.

The .Net 8 C# webcrawl library, soo to be pubished under a public Git source.
The library will come with xUnit Tests and Integration Tests.
Will be published along with a Windows Appication, built to a windows exe, but also with a public Git url to download the code.

Coming Soon