The goal is to distribute seed URLs among many waiting spider instances, whose requests are coordinated via Redis. Any other crawls those trigger, as a result of frontier expansion or depth traversal, ...
Try out the examples in the examples folder using the binder service. The package can also be installed on Google Colab using the commands: The easiest way to get started with the Control Systems ...