Python Script that Parse “Jobs”

This small python program scrapes data off of a ‘Hiring Now’ page on Hacker News or any other jobs websites and only saves the jobs with certain keywords. Ie ‘New York’, ‘San Francisco’ etc You can also use the keywords to find specific jobs ie ‘Machine Learning’

You need to install Beautiful Soup 4 in order to use this program

$ pip install beautifulsoup4

tested with python2.7-32

Problems

  • It will grab jobs that mention any of the keywords in your list.
  • It will break if someone creates a link with ‘More’ as the text 🙁

Downloads

Python Jobs Parser Script

I hope this tutorial will surely help you. If you have any questions or problems please let me know.

Happy Hadooping with Patrick..

Leave a Reply

Your email address will not be published. Required fields are marked *