CRX id
lbpejckmnfgigklkbbhacnheghokbago
lbpejckmnfgigklkbbhacnheghokbago
Description from extension meta
A simple extension to play along with YouTube piano roll videos. Real-time image analysis, 6-key input (SDF, JKL) for fun.
Image from store
Description from store
【Simple Piano Playtime】
This extension game analyzes existing YouTube piano roll videos in real-time as images, and plays sounds corresponding to the rising and falling of the keys in the video, in sync with user input. It's a simple piano-style extension game (?) where you can enjoy playing along using only 6 keys in total: [S, D, F] for the left hand and [J, K, L] for the right hand.
【Note: Videos where keys remain down during consecutive presses are currently unsupported】
This assumes piano roll videos where, during consecutive key presses, the key briefly returns to an "up" color just before the second press. If the key remains in the "down" color, the second press will not be registered as a hit. Videos created with SeeMusic or Synthesia seem to show the keys rising. Sometimes there are videos where they don't rise, perhaps they were created with other software...?
【Simple Instructions for Trying it Out】
1: First, go to the following piano roll video page.
└Trial video for feel: https://www.youtube.com/watch?v=oMkmR58vYT8
2: Wait for the page to load completely, then stop the video and click the toolbar icon.
*Steps 3, 4, and 5 are not necessary for this video, so they are omitted (playable with default settings).
6: If you want to adjust the volume, click the "+" button in the top left of the settings panel to expand it and set the details. You can collapse it with the "-" button.
7: When ready, click the "Play" button in the top center to start.
8: How to play:
├When a note falls to the bottom and the key is pressed/changes color:
│├If the key color is green (GRB) type:
││└It's a right-hand part note. Press any of [J, K, L]. Any of them is fine.
│└If the key color is anything else (blue in this video):
│ └It's a left-hand part note. Press any of [S, D, F]. Any of them is fine.
├[S, D, F] and [J, K, L] are not distinguished except for which part they belong to. The only thing that matters is the timing of the press.
│└Your timing will be evaluated as "Great, Nice, Bad" based on how accurate it is.
├Release the key when the note is almost out of sight. Release timing is not scored.
├Notes that start at the same time will all be sounded and silenced together with a single key press.
├If you press the key earlier than the key color change, the sound will play after waiting for the key to change.
│└Therefore, we recommend playing slightly late. (Due to the specifications, playing early will result in poor response.)
└To reset the score, pause and open the settings screen, then click the "Reset" button in the top right.
【How to Set Analysis Settings (Not Needed for This Video)】
4: Video Analysis Setting ①: Set the height with "CheckLineY".
├Not needed for the example page. Default settings should work.
└Stop the video at a frame where not all keys are pressed.
└Click the [+] at the right end of the item to enter setting mode.
└Click the vertical center of a black key in the video.
├The analysis line height will be set there.
└Be careful if the position is too high, as it may be obstructed by splash effects.
5: Video Analysis Setting ②: Set the hue of the right-hand key color with "R-Hand Hue".
├Not needed for the example page. Default settings should work.
└Stop the video at a frame where a right-hand key is pressed or a piece is displayed.
└Click the [+] at the right end of the item to enter setting mode.
└Click on the pressed right-hand key or piece in the video.
└The right-hand hue will be set from that color.
6: Video Analysis Setting ③: Set the note of the leftmost key with "1st Note".
├Not needed for the example page. Default settings should work.
└While the video is paused, pay attention to the red horizontal line drawn at the height of the Analysis Line Y in the video.
└There should be small vertical lines at the positions of the analysis points here and there.
└Pay attention to the leftmost vertical line (which is displayed a little longer and thicker than the others).
├Select the pitch and octave of that key from the selector.
└Often F2, A2, A#2, C2?
*Supported page: https://www.youtube.com/watch?v=*
**Special operations are required for "arpeggios" and groups of notes that "start at the same time but end at different times."
***Clicking the toolbar icon a second time or later will open a pop-up with option settings. Here you can initialize user data, edit analysis setting presets, and set sound fonts.
****For detailed instructions on how to play, click on the Help on the options page, or go directly to page/help_en.html.
【Confirmed Compatible Piano Roll Video List】
Operation confirmation list: https://www.youtube.com/playlist?list=PLClGWdao3s0cY9B_x0hj9Wlxhj4ndIkl0
List of playable songs: https://youtube.com/playlist?list=PLClGWdao3s0c3MiL89aTwQZbVy2kd2Qnj
【List of Used Libraries】
・FluidSynth by (C) 1991, 1999 Free Software Foundation
・js-synthesizer by (C) 2023 jet
・SC55 Piano_V2.sf2 by (C) 2017 Xiaosu Du