cleanup run_tests and add directories to the project config

fix running tests

generate skewed data for stat analysis.

restructure python codes, and init python file for a new progressive optimizer that controls lumpiness and optimizes in chunks instead of one trial per round.