Sign in

For those that mountain bike, hike trails, climb rocks, ride (pilot? steer?...I’m definitely not an equestrian) horse trails… you’ve been in my shoes.

“I’m new to the area…where do I start?”

“If only I knew a local who could pick a trail for me”

“Is this trail over my head/ability/skillset?”

So what do we do?

Well, fortunately, these days there are comprehensive apps available to subscribers that can aid us in these choices. We can select trails based on specified attributes and usually be recommended several others that the app ‘thinks’ we’d like as well. But how do these apps…


So, you’ve got a great idea! Maybe it’s an app, or perhaps some time series analysis. But… you need data.

It’s likely your data will not exist on Kaggle, or in a clean, updated ‘.CSV’ within easy reach. So, what do you do?

Photo by Glenn Carstens-Peters on Unsplash

You SCRAPE!

Assuming you already know how to set up a scraper (or use a third-party API), AND you decide to follow the website scraping policy, what can you scrape?

That’s where /robots.txt comes into play. Here’s a quick summary of what to look for when reviewing the /robots.txt page. Load up the site you’re looking to…


Jean-Claude in the high deserts of Utah
Jean-Claude in the high deserts of Utah
Our van, Jean-Claude RamVan

Back in the spring of 2018 my girlfriend and I wanted to take a trip. We were in the early stages of planning an epic adventure but weren’t sure what it would really end up being. At first, we wanted to complete a thru-hike. Perhaps the Appalachian Trail or Pacific Crest Trail. We had some friends and family that completed these hikes and thought it would be a great adventure for us to take on. Then we thought, how about a road trip? We’d take a couple of months and check out British Columbia, Canada, and the Pacific Northwest. …

Ryan McDonald

Engineer, Data Scientist, Adventurer

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store