Differences

This shows you the differences between two versions of the page.

--- brain:arcade_games [2017/01/05 00:02] – peter
+++ brain:arcade_games [2020/07/15 09:30] (current) – external edit 127.0.0.1
@@ Line 19: / Line 19: @@
 ale> make -j 4
 </code>
+Create a directory for the ROM files.
+<code bash>
+mkdir /ale/roms
+</code>
+and copy the binary rom files into that directory.
+<WRAP info>
+The DeepMind-Atari-Deep-Q-Learner-master.zip file at https://github.com/kuz/DeepMind-Atari-Deep-Q-Learner contains **breakout.bin**.
+Download this file too; or obtain roms from another source.
+</WRAP>
+Check that ALE has compiled correctly.
+<code bash>
+cd /ale
+ale -help
+</code>
+<WRAP info>
+This should display help tips
+</WRAP>
+Check the rom is able to be processed by ALE.
+<code bash>
+./ale rom/breakout.bin
+</code>
+This should display some details about the game.
+READ the manual at /ale/doc/manual/manual.pdf
+<code bash>
+cd /ale/doc/examples
+./sharedLibraryInterfaceExample
+./sharedLibraryInterfaceExample breakout.bin
+</code>
+<code bash>
+./ale -display_screen true roms/breakout.bin
+./ale -display_screen true -game_controller fifo roms/breakout.bin
+</code>
+Create a test program.
+<code bash>
+vi test.cpp
+g++ -o test test.cpp src/ale_interface.cpp -I/ale/src -L/ale -lale
+./test
+ls /etc/ld.so.conf
+cat /etc/ld.so.conf
+cat /etc/ld.so.conf.d/libc.conf
+ls /usr/local/lib
+cp libale.so /usr/local/lib
+g++ -o test test.cpp src/ale_interface.cpp -I/ale/src -L/ale -lale
+./test
+ldconfig
+./test
+./test roms/breakout.bin
+g++ -o test test.cpp src/ale_interface.cpp -I/ale/src -L/ale -lale -D__USE_SDL
+locate SDL.h
+g++ -o test test.cpp src/ale_interface.cpp -I/ale/src -L/ale -lale -D__USE_SDL -I/usr/include/SDL
+./test roms/breakout.bin
+./ale -display_screen true -game_controller fifo roms/breakout.bin
+</code>
+===== Install ImageMagick and supporting libs =====
+apt-get install imagemagick
+apt-get install libmagick++-dev
@@ Line 32: / Line 109: @@
 Perhaps different type neurons for different size images with some sort of standardisation comparison between unequal image sizes.
+Images - Convolutions
-Create a directory for the ROM files.
+update resolver's epsilon (chance of random action instead of optimal one)
+# epsilon decreases over time
+current_epsilon = 0.05 + 0.95 * np.exp(-epoch / 2500.)
+resolver.epsilon.set_value(np.float32(current_epsilon))
-<code bash>
-mkdir /ale/roms
-</code>
-and copy the binary rom files into that directory.
+# gamma - delayed reward coefficient - what fraction of reward is retained if it is obtained one tick later
+gamma = theano.shared(np.float32(1), name='q_learning_gamma')
-<WRAP info>
-The DeepMind-Atari-Deep-Q-Learner-master.zip file at https://github.com/kuz/DeepMind-Atari-Deep-Q-Learner contains **breakout.bin**.
-</WRAP>
@@ Line 51: / Line 126: @@
 https://www.nervanasys.com/deep-reinforcement-learning-with-neon/
+http://www.imagemagick.org/Magick++/tutorial/Magick++_tutorial.pdf