This small python program scrapes data off of a ‘Hiring Now’ page on Hacker News or any other jobs websites and only saves the jobs with certain keywords. Ie ‘New York’, ‘San Francisco’ etc You can also use the keywords to find specific jobs ie ‘Machine Learning’
You need to install Beautiful Soup 4 in order to use this program
$ pip install beautifulsoup4
tested with python2.7-32
- It will grab jobs that mention any of the keywords in your list.
- It will break if someone creates a link with ‘More’ as the text 🙁
I hope this tutorial will surely help you. If you have any questions or problems please let me know.
Happy Hadooping with Patrick..