← All Posts
Job Search Automation Toolkit
Job Search Automation Toolkit
Tools and Libraries
- Golang: The primary programming language for building the toolkit.
- Chosen in order to learn the language to better sell my Platform Engineering skillset
- Colly: A powerful and easy-to-use web scraping framework for
golang.- Used for scraping job listings from various job boards and company career
Themes Explored
- Concurrency - golang's concurrency model using goroutines and channels
- Web Scraping - using Colly to extract job listings and relevant data
- Modularity
- initial implementation makes use of a single service in order to focus on learning golang's concurrency model
- Eventually, the deployment will be moved to a
wasmclouddeployment that moves concurrency out of the application code and into the platform
- Debugging integration - integrating debugging tools to troubleshoot issues during scraping
- Observability - implementing logging and monitoring to track the toolkit's performance and usage
- Durable Execution - ensuring the toolkit can handle long-running tasks and recover from failures (useful for integrating with external AI services)