chore: remove crawler-related files and library dependencies, set up intern management database schema