Added mouse click operation

Author: Frieve-A

LICENSE

@@ -1,6 +1,6 @@
 BSD 3-Clause License
 
-Copyright (c) 2022, Yoshiyuki Kobayashi
+Copyright (c) 2022, Frieve-A
 All rights reserved.
 
 Redistribution and use in source and binary forms, with or without

README.md

@@ -1,6 +1,8 @@
 # Harmony Visualizer
 A tool for visualizing the harmony of MIDI input.
 
+(英語に続き日本語の解説があります)
+
 ![Harmony Visualizer](./images/harmony_visualizer.png)
 
 A tool for visualizing the harmony of the sound using virtual overtones based on MIDI input.
@@ -31,20 +33,30 @@ Follow the steps below to execute the Python code of the Feature Visualizer.
 
 ## How to use
 
-Connect your MIDI keyboard to your PC and launch the app.
+If a MIDI keyboard is available, connect the MIDI keyboard to your PC and launch the app.
 
-When you play a note with the MIDI keyboard, the notes you play are displayed in different colors on the keyboard for each note name. For example, Do is displayed in red, and So is displayed in blue which is a little closer to green.
+When you play a note with the MIDI keyboard or click on the keyboard, the notes you play are displayed in different colors on the keyboard for each note name. For example, Do is displayed in red, and So is displayed in blue which is a little closer to green.
 
 Above the keyboard display, a vertical line is displayed to indicate the volumme of the virtual overtones. For example, if you play Do, a vertical line indicating the second overtone is displayed at the Do position one octave higher, and the third overtone is displayed at the So position.
 
 If you input two or more sounds at the same time and the overtones are in harmony with each other, the overtones that are in harmony with the input sound are connected by a curve. The numbers on the curve indicate which overtones are in harmony.
 
 The graph on the upper left shows the volume of each overtone as a polar coordinate graph with a radius as a pitch and an angle that makes one round in one octave.
 
+To hold the display, press the CTRL key on your computer keyboard or press the damper pedal on your MIDI keyboard.
+
 Play your favorite songs and visually enjoy the harmony of the overtones!
 
 <br>
 
+## Keyboard shortcuts
+
+ESC : Exit the app
+
+F11 : Switch to full screen
+
+<br>
+
 ---
 
 <br>
@@ -77,17 +89,26 @@ https://github.com/Frieve-A/harmony_visualizer/releases
 
 ## 使い方
 
-PCにMIDIキーボードを接続してアプリを起動します。
+MIDIキーボードが利用できる場合、PCにMIDIキーボードを接続してアプリを起動します。
 
-MIDIキーボードで音を弾くと、弾いた音は音名毎にそれぞれ異なる色で鍵盤上に色分け表示されます。例えばドは赤色で、ソは少しグリーン寄りの青で表示されます。
+MIDIキーボードで音を弾くか、鍵盤上をクリックすると、弾いた音は音名毎にそれぞれ異なる色で鍵盤上に色分け表示されます。例えばドは赤色で、ソは少しグリーン寄りの青で表示されます。
 
 鍵盤表示の上には、仮想的な倍音の大きさを示す縦線が表示されます。例えばドを弾いた場合、1オクターブ上のドの位置に2倍音、ソの位置に3倍音を示す縦線が表示されます。
 
 2つ以上のを同時に入力しその倍音同士が調和している場合、入力した音と調和している倍音は曲線で結ばれます。曲線の上の数字は調和しているのが何番目の倍音であるかを示しています。
 
 左上のグラフはそれぞれの倍音の強度を、半径を音程とし、角度を1オクターブで1周するように設定した極座標グラフで表示したものです。
 
+表示をホールドするには、パソコンのキーボードのCTRLキーを押すか、MIDIキーボードのダンパーペダルを踏みます。
+
 好きな楽曲を演奏し、倍音同士が調和する様子を視覚的に楽しみましょう！
 
+## キーボードショートカット
+
+ESC : アプリを終了
+
+F11 : フルスクリーンへの切り替え
+
+
 
 

harmony_visualizer.py

@@ -116,11 +116,47 @@ def main():
     terminated = False
     last_time = time.perf_counter() - 10
     harmony_radius = np.zeros(128)
+    mouse_click_note = -1
     while (not terminated):
         current_time = time.perf_counter()
         last_wait_ms = (current_time - last_time) * 1000
         last_time = current_time
 
+        # handle events
+        for event in pygame.event.get():
+            if event.type == QUIT:
+                terminated = True
+            elif event.type == KEYDOWN:
+                if event.key == K_ESCAPE:
+                    terminated = True
+                elif event.key == K_F11:
+                    full_screen = not full_screen
+                    if full_screen:
+                        screen = pygame.display.set_mode(screen_size, FULLSCREEN)
+                    else:
+                        screen = pygame.display.set_mode(screen_size)
+                elif event.key == K_LCTRL or event.key == K_RCTRL:
+                    damper = True
+            elif event.type == KEYUP:
+                if event.key == K_LCTRL or event.key == K_RCTRL:
+                    damper = False
+            elif event.type == MOUSEBUTTONDOWN and event.button == 1:
+                for key in [key for key in keyboard[21:109] if key.black_key]:
+                    if event.pos[0] >= key.x - black_key_width / 2 and event.pos[0] < key.x + black_key_width / 2 and event.pos[1] >= keyboard_top and event.pos[1] < keyboard_top + black_key_height:
+                        mouse_click_note = key.note_no
+                if mouse_click_note < 0:
+                    for key in [key for key in keyboard[21:109] if not key.black_key]:
+                        if event.pos[0] >= key.x - white_key_width / 2 and event.pos[0] < key.x + white_key_width / 2 and event.pos[1] >= keyboard_top and event.pos[1] < keyboard_top + white_key_height:
+                            mouse_click_note = key.note_no
+                if mouse_click_note >= 0:
+                    keyboard[mouse_click_note].key_on = True
+                    keyboard[mouse_click_note].attack = 1.0
+                    keyboard[mouse_click_note].db = 96.0
+
+            elif event.type == MOUSEBUTTONUP and event.button == 1:
+                keyboard[mouse_click_note].key_on = False    
+                mouse_click_note = -1
+
         # midi in
         for midi_in in midi_ins:
             if midi_in.poll():
@@ -141,6 +177,8 @@ def main():
                                 damper = midi_event[0][2] > 0
                         # print(midi_event)
 
+        # mouse in
+
         # update keyboard status
         overtone_list = []
         harmony_buf = [[] for i in range(128)]
@@ -256,20 +294,7 @@ def main():
         # draw
         pygame.display.update()
 
-        # handle keyboard events
-        for event in pygame.event.get():
-            if event.type == QUIT:
-                terminated = True
-            elif event.type == KEYDOWN:
-                if event.key == K_ESCAPE:
-                    terminated = True
-                elif event.key == K_F11:
-                    full_screen = not full_screen
-                    if full_screen:
-                        screen = pygame.display.set_mode(screen_size, FULLSCREEN)
-                    else:
-                        screen = pygame.display.set_mode(screen_size)
-
+        # wait
         pygame.time.wait(10)
 
     for midi_in in midi_ins: