phd
Table of Contents
- Prolongation again
- confirmation about semester ticket
- Presentation for submitting
- Prolongation
- CSC
- Fellowships for Completion of Degree
- Application
- Current proof of enrolment (Immatrikulationsbescheinigung)
- Certified academic performance record (Leistungsnachweis)
- Proof of financial status
- Letter of recommendation from a HU professor
- Official statement specifying the estimated end of studies (Studienprognose), issued by the Prüfungsamt of your Faculty
- dissertation
- Note of writing a Ph.D thesis
- write a short report (discuss with Dieter)
- Reading
- Coding
- Writing TeX
- extent the length of thesis
- accept reviews from Dieter II
- accept reviews from Dieter
- Mon Mar 5 11:06:45 2012 (the reason (equation) for stiffness)
- check grammar by After the Deadline and LanguageTool
- Chapter 1
- Chapter 2
- Chapter 3
- some text about "reality gap"
- Summary of simulator
- focus on the topic of 'simulation and reality'
- put the comments from Dieter into paper
- copy avaiable text from my papers
- some text from others
- read the text of my orignal proposal and copy some text
- search simulators( robot, game, etc.)
- How to
- CSC report
- Paper
- proposal
- A talk about my previous work [100%]
- Clock Table
TODO Prolongation again
- 申请教授资助
- 博士后
- 没有资助
- 住房合同
- 保险证明
- 先回国,再回来答辩
- 论文提交证明
DONE SEU
DONE contact SEU
- 需要哪些材料
- 联系方式
DONE professor
DONE Presentation for submitting
review the slides, make it compat and clean
listen to the record of prensetation in DFKI
DONE test presentation in NaoTH
DONE prepare the presentation [100%]
- DONE put all figures in slides
- DONE go through and struct the slides
- DONE embed the video in slides
- CANCELED write some notes for presentation
- DONE create first draft slides with figures/equations
- DONE create video / figure of kinect experiment [66%]
[X]create a video from real robot[ ]create a video from simulation[X]create a point video from real robot[X]create a point video from simulation[ ]create a video from both real robot and simulation[X]create a point video from both real robot and simulation
DONE Prolongation
DONE CSC
本人申请书
draft
国内大学同意函(带文号的大学正式函,不是学院级的)
waiting for Ms. Tan
- DONE reply Ms. Tan:(send application and letter from Dieter)
DONE 德国导师同意函
- 继续资助证明
should be ready today
DONE Fellowships for Completion of Degree
DONE Application
need some text
Current proof of enrolment (Immatrikulationsbescheinigung)
学生证
Certified academic performance record (Leistungsnachweis)
硕士证书、比赛成绩、发表论文清单
Proof of financial status
奖学金证明
DONE Letter of recommendation from a HU professor
Dieter
Official statement specifying the estimated end of studies (Studienprognose), issued by the Prüfungsamt of your Faculty
Ask Dr. Anna Brömmer
TODO dissertation
Note of writing a Ph.D thesis
Typesetting system: LaTeX
- HU template
- tikz
- each figure in a separate file
- use tikz2pdf for editing and preview
- include with 'external' package
- each figure in a separate file
- todonotes
- custom command
- patch for working with pgf external package
- File structure
- subfiles
- include bibtex for each chapter
- Makefile
- subfiles
- Other packages
- cleveref
- forloop
- amsmath, isomath, …
- Other customized command
- quote/quotation
- Editor: Emacs
- forward/backward search
- flyspell, predictive mode
- math: algin instead of eqnarray
- table number in appendix
\renewcommand\thetable{A.\arabic{table}}
- Draft watermark
Version control and back up
- git
- dropbox
DONE write a short report (discuss with Dieter)
The dissertation will contains three main parts…
Reading
CANCELED Sensor modeling
- list of sensors
- related papers
Coding
DONE merge code from master to thesis branch
TODO optimize speed of standing up [40%]
[X]check why the binary doesn't work in gruenau4: Because of restarting simspark in each run, the system is busy with reading files, so limit 5 process that don't make other guys crazy (The priority of my account is higher than students, so maybe my processes take over the whole system, so I use `nice +5` to start my program and limit to 5 processes.)[X]fix problem of fitness- check the lenght of file that if all data have been writen!
- whether the old files are used?
- the robot is just lucky! (because the random of simspark?) –>
run simulation 3 times
- the server crashed…!
- the robot stood up in 0.5 second for 3 times!! but then I can not repeat the experiment!!
- the server is not in 'sync' mode, set it and try again –>
it doesn't matter, the robot still stands up so fast!
- try to repeat it in 'sync' mode –> still stands too fast and can not repeat –> FIXED: problem of setting 'sync' mode
[ ]check configuration of simspark (parameters)- default parameters: 742 ms
- max speed -> nominal speed: 477 ms
[X]the max force for each joint![ ]the nominal force is too weak for robot[ ]try to limit force in arm only
- change ERP and CFM **
- 改变碰撞参数
- self collision
- joint parameters: force, speed
[ ]run the experiment[ ]check if the result is promising
TODO auto-generate standing up [80%]
- DONE save the logfile for creating a video later
- DONE limit the joints range
- DONE create a script to generate video [100%]
- DONE generate video from logfile
- grab frames from OpenGL
- DONE turn frames to video
ffmpeg -r 25 -i %05d.png output.mp4
- grab frames from OpenGL
- DONE generate video from logfile
- TODO better fitness function
- the 'best' result just because of the server crashed!! -> check
if the robot was on ground, otherwise the fitness is 0
- the program crash because of empty file
- The robot can only sit on the ground, but can not stand up
- use the max height as fitness (bugfixed)
- test fitness proposed in dissertation
- the 'best' result just because of the server crashed!! -> check
if the robot was on ground, otherwise the fitness is 0
DONE system identify for power consuming of motor [100%]
- DONE read data from robot logfiles
- DONE system identify
- from NaoQi
There are two different Devices that return a temperature: the MotorBoard, and the Battery. For both, the temperature returned in “Value” is in deg Celsius. The motor temperature is a simulated one, using electric current value of the motor. Even when the robot just starts, the temperature is quite high (50°C).The simulation starts at this value mainly due to the internal temperature value. The motor board implements a temperature limitation: as long as the simulated temperature reaches 75°C, the current limitation is decreased to stay under 85°C.
- from NaoQi
- DONE battery trajectory [100%]
[X]write xabsl to repeat the behavior[X]copy walk parameters from real robot and use old foot trajectory[X]current feedback[X]add code in perceptor (server)[X]add code in agent (client)
[X]tempeature feedback[X]add code in server[X]add code in client
[X]set correct parameters of motors[X]export function to ruby[X]configure RSG files
[X]stiffness control[X]code in server[X]code in agent
[X]the feedback of hinge joint is not only motor force![X]AMotorEffector[X]AMotorPerceptor[X]using AMotor in rsg
[X]run the experiment and record logfile[X]analysis logfile
TODO learning foot trajectory [75%]
- DONE create a static splines foot trajectory
- DONE make the trajectory configurable
- DONE run GA [100%]
- DONE battery sensoring
- DONE walk behavior and save the battery state to file [100%]
[X]walk behavior: start and walk forward 60s and exit[X]save the battery state
- DONE run in gruenau2 [100%]
[X]install new server [100%][X]package new server[X]upload[X]install
[X]install new naoth [100%][X]package[X]upload[X]compile
- DONE battery sensoring
DONE auto parameters (repeat experiment of others)
- choose parameters which will be ajusted automatically
- make the parameters ajustable
- do some experiement in real robot to get data
- do the experiement in simulation to adjust the parameters
- validation
Writing TeX
DONE accept reviews from Dieter II
- State "DONE" from ""
- general suggestion
- English
- general outline
- evoluationary instead of genetic
- English
- suggestion in each chapter
DONE accept reviews from Dieter
- general suggestion
- compare with other tools (webots)
- English
- own work in SimSpark
- program, documentation (work reference to thesis)
- how to make ML in SimSpark
- comparsion bwteen results of ML in Sim + real ("close loop")
- compare with other tools (webots)
DONE Mon Mar 5 11:06:45 2012 (the reason (equation) for stiffness)
the reason (equation) for stiffness
DONE check grammar by After the Deadline and LanguageTool
- State "DONE" from "TODO"
DONE Chapter 1
- some text from MS Robotics
DONE Chapter 2
- DONE V&V methods
- DONE clean/restruct the text copied(cited)
- DONE read through and remove some todos
- DONE consider which part are really necessary and make a plan for using in later sections
- DONE review section 1.1.2: evaluation based on system identification
- DONE clean/restruct the text copied(cited)
- conceptual model validation
- physical model
- DONE rigid body dynamcis
- DONE finish rigid body dynamics citing(after this no new text/idea come in)
- DONE finish rigid body dynamics citing(after this no new text/idea come in)
- engine validation experiment
- CANCELED constraints -> still need to experiement
- DONE deterministic
- DONE experiement
- DONE add some text
- DONE experiement
- DONE cite some text
- DONE run the experiement
- DONE write the section
- CANCELED constraints -> still need to experiement
- DONE collision
- DONE friction
- DONE rigid body dynamcis
- robot hardware model
- actuators(motors)
- DONE single joint test(cos), add the current test result and some text
- DONE do the experiment
- DONE run cos test again in rcssserver 2011
- DONE run step function in rcssserver 2011
- DONE how to test leg joints? –> remove ground collision
- DONE write some text about result in simulation
- DONE run cos test again in rcssserver 2011
- DONE create a table for different type of joints
- DONE single joint test(cos), add the current test result and some text
- actuators(motors)
- physical model
- DONE results validation
- DONE Walk speed [2/2]
[X]scrpit for extracting speed info from logfiles[X]write some text, about algorithm and etc.
- DONE repeat the old joint test(stand up), plot some figures and included in the thesis
- stand up motion in real robot
- DONE prepare the code for run in the real robot
- DONE run some test in real robot
- kinect
- DONE basic system frame work [2/2]
[X]read/load kinect data[X]read logfile data, rendering (another logplayer)[X]why pyparse is so slow? -> it is[X]try to load and play a game log[X]make it faster -> it is still slow for 9 vs 9 game, but it should be fast enough for 1 robot
- compare depth image
- simulated kinect
[X]shader for depth image[X]save image data
- sync two cameras
- time: log the data with robot's command, i.e. robot give information about time
- camera position: use point cloud registeration at the beginning
- comapre by image
[X]what kind of algorithm is avaiable
- statistic data, plot
- simulated kinect
- video comparsion
- good calibrated kinect
- make some cool video demo
- advanced: gesture recognization
- estimate chest rotation
- estimate joint angle, compare
- advanced: sync robot and kinect
- DONE write the idea about using kinect
- DLR low-cost sensor workshop
- DONE submit abstract
- DONE submit abstract
- DONE intergrate kinect driver in REP
- DONE calibration [1/1]
[X]image show by matplotlib- single figure without main window –> Qt.exec has to be in main thread!!
[X]calibrate framework[X]calibrate video camera of kinect[X]calibrate IR camera of kinect[X]calibrate relation between two cameras
- DONE video camera
- DONE calibration [1/1]
- DONE basic system frame work [2/2]
- DONE prepare the code for run in the real robot
- DONE Walk speed [2/2]
- DONE read and restruct it in paper
DONE Chapter 3
- DONE clean old text with new structure
- DONE read paper "Extending Open Dynamics Engine for Robotics Simulation"
DONE some text about "reality gap"
- DONE some refercen to "reality gap" papers
DONE Summary of simulator dissertation
- State "DONE" from "TODO"
- search for physic simualtion engine
- download some documents and binaries of simulators(maybe some new one?)
focus on the topic of 'simulation and reality'
- related work
- UCHILSIM
- UCHILSIM: A Dynamically and Visually Realistic Simulator for the RoboCup Four Legged League
- the problem of evolution in real robot:
- costs time
- damage
- reality gap: the difference between simulation and reality
(no matter how accurate a simulator is)
- representation by fitness
- UCHILSIM is able to adapt its parameters automatically, by comparing robot controller behaviors in reality and in simulations.
- there are few examples of the generation of complex robotic behaviors in a simulation with successful transfers to reality.
- We believe that it is possible to generate accurate simulators at a level in which it is feasible to learn complex behaviors with the successful transfer of these behaviors to reality.
- The Back to Reality paradigm combines into a single framework: learning from reality and learning from simulations.
- the problem of evolution in real robot:
- Back to Reality Crossing the Reality Gap in Evolutionary Robotics
- it is a promising approach for crossing the reality-gap among simulation and reality in evolutionary robotics
- it allows to generate automatically models and theories of the real robot environment expressed as simulations
- Learning to Kick the Ball Using Back to Reality
- Our goal is to produce an optimal ball kick behavior for any given robot relative ball position and target direction that the robot might access without repositioning itself.
- The difference in fitness obtained in simulation versus reality is minimized trough a learning process in which the simulator is adapted to reality. In other words the robot continuously generates an internal representation of their environment while adapting the simulator.
- UCHILSIM: A Dynamically and Visually Realistic Simulator for the RoboCup Four Legged League
- Minimal Simulation
- Running across the reality gap: Octopod locomotion evolved in a minimal simulation
- The basic idea of a minimal simulation is to model only those robot-environment interactions that are necessary to underpin a desired behavior.
- Everything else is made unreliable by careful use of randomness. In this way an evolved controller is forced to use the minimal set of interactions picked out by the simulation designer. This set of interactions is modelled as simply (i.e. computationally cheaply) as possible by using an envelope of noise to mask the inaccuracies of the modelling. Again, by careful use of randomness, controllers evolve that are robust to these inaccuracies and hence will cross the reality gap.
- Noise and the reality gap: The use of simulation in evolutionary robotics
- Khepera robot
- The evolved controllers were downloaded onto the real robot and the correspondence between behavior in simulation and in reality was tested.
- It has been demonstrated that it is possible to develop successful robot controllers in simulation that generate almost identical behaviours in reality, at least for a particular class of robot-environment interaction dynamics.
- Whereas these abstract models can be very useful in exploring some aspects of the problem of control in autonomous agents, great care must be taken in using them to draw conclusions about behavior in the real world.
- Brooks was highly sceptical: There is a real danger (in fact, a near certainty) that programs which work well on simulated robots will completely fail on real robots because of the differences in real world sensing and actuation - it is very hard to simulate the actual dynamics of the real world.
- it was argued that as the robot's sensory coupling with its environment becomes more complex, simulations would become extremely difficult to construct and would be slower than real time unless highly specialised hardware were available.
- Noise also plays a part in determining the quality, The Noise Level Has to Be Right
- great care must be taken in building the simulation and appropriate levels of noise must be included.
- The robot-environment interactions modelled here are relatively simple.
- Running across the reality gap: Octopod locomotion evolved in a minimal simulation
- Evolving Autonomous Biped Control from Simulation to Reality
- Transferring an evolved control system from a simulated environment to the physical world poses a number of challenges. The difficulty in accomplishing such a task increases the complexity of the system that is being simulated and controlled increases. One of the most challenging control tasks is to generate a stable walking gait for a bipedal robot.
- Dynamechs is an efficient rigid-body dynamic simulation library that is based on the Articulated Body Algorithm (ABA) developed by Featherstone
- Various approaches have been tried to enable the seamless transition from simulated controllers to the physical world.
- Jakobi argues that such approaches will always fail to transfer from simulation to reality, as the evolved controllers come to depend on certain aspects that are only present in the simulation, and are not reflected in the physical world.
- A spline based control system is responsible for manipulating the servo inputs.
- the problem observed in this system are believed to arise from the incomplete servo model and the shortcoming of the robot hardware.
- Flying over the reality gap: From simulated to real indoor airships
- Neuronal controllers are evolved in simulation to map visual input into motor commands in order to steer the flying robot forward as fast as possible while avoiding collisions.
- The novelty in this first part does not lie in the mathematics of the model itself, which has been mainly adapted from fluid dynamics theory, but rather in the pragmatic methodology for swift identification of the different constitutive parameters of the model.
- A major drawback of using artificial evolution to discover efficient robot controllers, that is the time it takes for evaluating a whole population of controllers over a number of generations (which is even more problematic with physical flying robots that may be damaged by collisions, have limited on-board energy, and have actuators performance that change over time), has been addressed in this article by demonstrating the use of physics-based simulation and successful transfer to reality.
- However, systematic analysis of the importance of each parameter and component of the model has not been carried out and good correlation between simulation and reality has been demonstrated only within a specific navigational task where altitude was automatically kept constant.
- UCHILSIM
DONE put the comments from Dieter into paper
DONE copy avaiable text from my papers
- DONE copy text from proposal
DONE some text from others
DONE read the text of my orignal proposal and copy some text
DONE search simulators( robot, game, etc.)
- robotics simulator (from Robotics Simulator in wikipedia)
Simulator Developer Year Licence Physics Engine Rendering Engine Scene Description Architecture Robots Programming Language Application SimSpark RoboCup Community 2003- GPL ODE OpenGL Ruby Scene Graph TCP/IP HOAP, Nao C++ RoboCup 3D Simulation League SimRobot B-Human 1994- Open ODE OpenGL XML Monolithic AIBO, Vehiele, Nao C++ B-Human Nao Team Gazebo researches 2007- GPL ODE, Physsim OGRE XML TCP/IP, JINI, CORBA Vehicle USARSim University of California, University of Pittsburgh, National Institute of Standards and Technology USA 2003- GPL Unreal Engine Unreal Engine Unreal map TCP/IP Vehicle RoboCup Rescue Simulation League OpenHRP AIST, Japan 1998- EPL1 own VRML CORBA HRP C, C++, Java HRP Webots Cyberbotics Ltd. 1996- Commerical ODE OGRE VRML TCP/IP Vehicle, Nao, ABIO, … C++, Java, Python, Matlab MSRS Microsoft 2007- Commerical PhysX DirectX XML DSS Arm, Vehiele, Dog, Nao C# UCHILSIM Universidad de Chile 2004 Demo only ODE OpenGL VRML Monolithic AIBO C++ RoboCup Four Legged League - features
- fast robot prototyping
- physics engine: ODE, PhysX
- 3D rendering
- scripting: URBI, Matlab, Python
- Literature
- OpenHRP
- Open architecture humanoid robotics platform
- This application doesn’t need porting of the controller thanks to the controller unification mechanism of OpenHRP. This mechanism is realized by introducing an adaptor which generalizes interfaces of the hardware body and the software body in the simulation world. Therefore, this application is done by simply replacing an adaptor for the simulated body with one for the real one.
- OpenHRP: Open Architecture Humanoid Robotics Platform
- the unification of the controllers for the simulated and real robot is realized by hardware abstraction and synchronization mechanism.
- Thanks to the unification, the controllers can share a significant amount of software with simulator, including the parameter parser, kinematics and dynamics computation and collision detector.
- The compatibility between the simulation and experiments is enhanced by introducing a new algorithm to simulate contact force and torque between objects. Although the analytical (or impulse-based) methods are more numerically stable and efficient than explicit methods which compute the contact force and torque, however the explicit methods have an advantage when a mechanical spring-damper is implemented on the feet of a robot such as HRP-1.
- Design Concepts:
- Modularity
- Open architecture
- Portability
- Open architecture humanoid robotics platform
- OpenHRP
- Open Source
- LpzRobots
- OpenSim
- Simbad
- breve (Python)
- Blender
- Moby
- LpzRobots
- Commercial
- anyKode Marilou
- Webots
- MSRS
- RoboLogix
- Visual Components
- SimplySim
- Actin
- Workspace
- features
How to
General
- 《帕尔格雷夫研究技巧系列-博士论文写作技巧》
- 如果你在作品中只谈论你读过什么,那么没人会读你的作品
- 很多时候,相信自己会取得很大成就是你能够取得任何成就的前提条件
- 每当遇到难懂的文章,我们都需要做出抉择:要么认定作者无能,要么 认定我们自己愚蠢
- 遇到好的表达方式时不要犹豫,把它拿过来以供己用
- 对于创造性非小说作品,写作过程的实质就是一个人坐在桌子旁边,要 么周围摆满了各种信息、备注、潦草的笔记和资料,要么脑子里萦绕着 各种想法,然后挣扎着将这些想法落实到空白的屏幕或纸面上
- 为了获得与在电脑上写作不同的视角,把你的材料打印出来。如果只在 屏幕上进行编辑工作,那么你对论文的改动只会局限于小规模的字面修 正和变化。在纸上上编辑论文时,你才会发现还可以进行更加根本的改 变,比如把大块文字移动到几页之外的位置上
Humboldt University Berlin
DONE CSC report
In the last half year, I worked busily, because there were many
RoboCup competitions have to be participated in. We have
participated in 4 competitions in two months. The results are
delightful: Top 8 in Iran Open Simulation League, champion in
German Open Simulation League and 4th in German Open Standard
Platform League, 2nd in Mediterranean Open, champion in 1st RoboCup
tournament in Greece. Especially, it was the first time that the
same source code played in two leagues: both simulation and real
robot. It is first step of my research topic: "Migrating Robot from
a purely Virtual World to an entirely Real Implementation"
Beside competitions, I have submitted two papers collaborated with my colleague. "Adaptive motion control with visual feedback for a humanoid robot" is submitted to 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, "Vision-based adaptive motion control for a humanoid robot" is submitted to 33rd Annual German Conference on Artificial Intelligence.
RoboCup 2010 will be held in Singapore in June, we will participate in simulation league there. Currently we are working on it.
DONE send it
Paper
DONE SIMPAR paper
DONE Hotel –> waiting for reply
DONE poster
[X]check[X]print
- DONE template (LaTeX?)
DONE formal for institute
- DONE book the ticket
DONE paper for CS&P 2010
DONE submission of papers
DONE abstract
think about a topic –> sth. about simulation and real robot
validation/comparison between simulation and real robot
DONE KI paper
DONE Slides for presentation
DONE Slides submission
DONE Early Bird Registration
DONE submission of the final version
DONE proposal
DONE A talk about my previous work [100%]
[X]clear some question: who[X]list what to talk ( key point )[X]make the beamer template[X]make a movie of Top 5 goal in RoboCup 2008[X]download and install Flash CS[X]download X capture[X]download logfiles of RC 2008[X]chose a background music[X]record the movie and make the flash
[X]fill the content of list & make the beamer[X]write down the notes for the talk, practice once[X]practice again
Clock Table
Clock summary at
| Headline | Time | |
|---|---|---|
| Total time | 113:13 | |
| DONE Presentation for submitting | 17:08 | |
| DONE [#C] create a presentation template | 0:18 | |
| DONE make a draft plan | 0:13 | |
| DONE test presentation in NaoTH | 16:37 | |
| DONE Prolongation | 1:08 | |
| DONE… | 1:08 | |
| TODO dissertation | 94:57 | |
| Coding | 59:41 | |
| Writing… | 35:16 |
Footnotes:
1 Eclipse Public License