Sage Research Methods Video: Data Science, Big Data Analytics, and Digital Methods - Automated Data Collection: Web Scraping Example, Part 2

Name: Automated Data Collection: Web Scraping Example, Part 2
Uploaded: 2019-01-21
Duration: 17 min 3 s
Description: Matt Denny continues the discussion of how to extract data from messy source code, such as Google Scholar, and creates a function to solve this problem.

Transcript

Video Type: Tutorial

Tools
Tools icon close
- Get link
  
  Get link icon close
  
  Select a length: Entire video
  
  Link to this page directly with a permalink:
  https://methods.sagepub.com/video/automated-data-collection-web-scraping-example-part-2
  
  Copy to clipboard
  
  Cancel
- Cite
  
  Cite icon close
  
  Format APA
  
  Denny, M. (Academic). (2017). Automated data collection: web scraping example, part 2 [Video]. Sage Research Methods. https://doi.org/10.4135/9781526473660
  
  Denny, Matthew. "Automated Data Collection: Web Scraping Example, Part 2." In Sage Video. London: SAGE Publications Ltd, 2017. Video, 00:17:03. https://doi.org/10.4135/9781526473660.
  
  Denny, M., 2017. Automated Data Collection: Web Scraping Example, Part 2, Sage Video. [Streaming Video] London: Sage Publications Ltd. Available at: <https://doi.org/10.4135/9781526473660 & gt; [Accessed 28 May 2023].
  
  Denny, Matthew. Automated Data Collection: Web Scraping Example, Part 2. Online video clip. SAGE Video. London: SAGE Publications, Ltd., 21 Jan 2019. doi: https://doi.org/10.4135/9781526473660. 28 May 2023.
  
  Automated Data Collection: Web Scraping Example, Part 2 [Streaming video]. 2017. doi:10.4135/9781526473660. Accessed 05/28/2023
  copy to clipboard
  or
  
  Export to your reference manager Endnote
  
  Export
  
  Cancel
- Share
  
  Share icon close
  
  Share via
  
  Email
  
  Please log in from an authenticated institution or log into your member profile to access the email feature.
  
  Sign in/register
- Embed
  
  Embed icon close
  
  Embed this Content
  Add this content to your learning management system or webpage by copying the code below into the HTML editor on the page. Look for the words HTML or </>. Learn More about Embedding Video icon link (opens in new window)
  
  Clip - https://methods.sagepub.com/video/automated-data-collection-web-scraping-example-part-2
  
  Embed code:
  
  Copy to clipboard
  
  Select a length: Entire video
  
  Select a size:
  
  420x236
  
  640x360
  
  853x480
  
  Sample View:
  (opens in new window)
  
  Cancel
- Download PDFopens in new window

Summary
Chapters
Video Info
Supplementary material

Summary

Matt Denny continues the discussion of how to extract data from messy source code, such as Google Scholar, and creates a function to solve this problem.

Chapter 1: Review of Google Scholar Source Code
icon angle down
- Start time: 00:00:00
- End time: 00:02:49
Chapter 2: Using "str_split()" to Search for Start and End of Desired Data
icon angle down
- Start time: 00:02:50
- End time: 00:07:08
Chapter 3: Using "grepl" and "str_split()" to Scan For and Isolate Data
icon angle down
- Start time: 00:07:09
- End time: 00:11:56
Chapter 4: Defining and Testing the Function
icon angle down
- Start time: 00:11:57
- End time: 00:17:03

Product: Sage Research Methods Video: Data Science, Big Data Analytics, and Digital Methods
Type of Content: Tutorial
Title: Automated Data Collection: Web Scraping Example, Part 2
Publisher: SAGE Publications Ltd
Series: Practical Data Management with R
- Publication year: 2017
- Online pub date: January 21, 2019
Discipline: Geography
Methods: Data management, R statistical package, Web scraping, Application programming interfaces
Duration: 00:17:03
DOI: https://doi.org/10.4135/9781526473660
Keywords: automation, computer programming, internet data collection, programming and scripting languages, web sites
People
Academic: Matthew Denny

Online ISBN: 9781526473660

Copyright: © Matthew Denny, 2017

More informationLess information

More informationLess information

Tools
Tools icon close
- Get link
  
  Get link icon close
  
  Select a length: Entire video
  
  Link to this page directly with a permalink:
  https://methods.sagepub.com/video/automated-data-collection-web-scraping-example-part-2
  
  Copy to clipboard
  
  Cancel
- Cite
  
  Cite icon close
  
  Format APA
  
  Denny, M. (Academic). (2017). Automated data collection: web scraping example, part 2 [Video]. Sage Research Methods. https://doi.org/10.4135/9781526473660
  
  Denny, Matthew. "Automated Data Collection: Web Scraping Example, Part 2." In Sage Video. London: SAGE Publications Ltd, 2017. Video, 00:17:03. https://doi.org/10.4135/9781526473660.
  
  Denny, M., 2017. Automated Data Collection: Web Scraping Example, Part 2, Sage Video. [Streaming Video] London: Sage Publications Ltd. Available at: <https://doi.org/10.4135/9781526473660 & gt; [Accessed 28 May 2023].
  
  Denny, Matthew. Automated Data Collection: Web Scraping Example, Part 2. Online video clip. SAGE Video. London: SAGE Publications, Ltd., 21 Jan 2019. doi: https://doi.org/10.4135/9781526473660. 28 May 2023.
  
  Automated Data Collection: Web Scraping Example, Part 2 [Streaming video]. 2017. doi:10.4135/9781526473660. Accessed 05/28/2023
  copy to clipboard
  or
  
  Export to your reference manager Endnote
  
  Export
  
  Cancel
- Share
  
  Share icon close
  
  Share via
  
  Email
  
  Please log in from an authenticated institution or log into your member profile to access the email feature.
  
  Sign in/register
- Embed
  
  Embed icon close
  
  Embed this Content
  Add this content to your learning management system or webpage by copying the code below into the HTML editor on the page. Look for the words HTML or </>. Learn More about Embedding Video icon link (opens in new window)
  
  Clip - https://methods.sagepub.com/video/automated-data-collection-web-scraping-example-part-2
  
  Embed code:
  
  Copy to clipboard
  
  Select a length: Entire video
  
  Select a size:
  
  420x236
  
  640x360
  
  853x480
  
  Sample View:
  (opens in new window)
  
  Cancel
- Download PDFopens in new window
Data management

Discover method in the Methods Map

Resources

Supplemental Materials

Supplemental materials

Click here to download the dataset for this video.

Sign in to access this content

Get a 30 day FREE TRIAL

Watch videos from a variety of sources bringing classroom topics to life
Read modern, diverse business cases
Explore hundreds of books and reference titles

Video Type: Tutorial

Transcript

Summary

Chapters

Video Info

Supplementary material

Chapter 1: Review of Google Scholar Source Code

Chapter 2: Using "str_split()" to Search for Start and End of Desired Data

Chapter 3: Using "grepl" and "str_split()" to Scan For and Isolate Data

Chapter 4: Defining and Testing the Function

Resources

Resources

Sign in to access this content

Get a 30 day FREE TRIAL

Sage Recommends

No internet connection.

All search filters on the page have been cleared.

Your search has been saved.

Automated Data Collection: Web Scraping Example, Part 2

Video Type: Tutorial

Transcript

Summary

Chapters

Video Info

Supplementary material

Chapter 1: Review of Google Scholar Source Code

Chapter 2: Using "str_split()" to Search for Start and End of Desired Data

Chapter 3: Using "grepl" and "str_split()" to Scan For and Isolate Data

Chapter 4: Defining and Testing the Function

Discover method in the Methods Map

Resources

Resources

Sign in to access this content

Get a 30 day FREE TRIAL

Read next

More like this

Sage Recommends