I figured it out fairly quick.
I started with blue, and went in a square-ish-circle from blue-red-green-yellow. (do it twice)
For the second set, you zig zag starting from the lower right, upper left, upper right, lower left.
I'm sure it's not any different in each game, so give that a try.

Btw, I cant read one bit of Japanese, I just took a loooong time looking around for clues, and couldn't find any, so I started running in circles and eventually it worked.

Good luck, hope I'm right!