Skip to content

Showcase visualizations about Common Japanese Morphemes in YOASOBI Lyrics

Notifications You must be signed in to change notification settings

sakan811/Common-Japanese-Morphemes-in-YOASOBI-Lyrics

Repository files navigation

Common Japanese Morphemes in YOASOBI Lyrics

Update June 9th, 2024

Showcase visualizations about the common Japanese morphemes in YOASOBI's songs' lyrics.

Morphemes are the smallest units of meaning in a language.

Status

CodeQL
Scraper Test

Project Details

Lyrics were based on genius.com

Japanese morphemes were extracted using SudachiPy and romanized using Cutlet.

Based on 25 YOASOBI songs

Visualizations

Power BI
Instagram
Facebook

Code Base Details

To Start Web-scraping Process

  • Go to main.py
  • Run the script.
  • Data is saved to a SQLite database 'yoasobi.db'.

pipeline.py

  • Contain functions of the web-scraping pipeline.

data_extractor.py

  • Contain functions related to extracting the desired data.

sql_query.py

  • Return a specific SQL query.

sqlite_db.py

  • Contain functions that deal with the database itself.
  • Migrate the scraped data to SQLite database.

utils.py

  • Contain utility functions.

web_scraper.py

  • Contain functions related to fetching content from the webpage.