Many wants to run Box2D based gym but it is sth you have to install by yourself like Mujoco series gym envs. To list the environments available in your installation, just ask gym.envs.registry: Many uses python 3.6 but the easiest way of installing Box2D, which is $ conda install -c kne pybox2d doesn't work cuz pybox2d has been maintained til py3.5. I think video_recorder.py should probably use imageio which already has a package, imageio-ffmpeg, and then we don't need a ffmpeg dependency. Install complete OpenAI Gym in Command Prompt: conda install git conda install -c conda-forge ffmpeg # Note: For video recording. conda-forge is a community-led conda channel of installable packages. It is a Python class that basically implements a simulator that runs the environment you want to train your agent in. conda install pandas conda install tensorflow pip3 install gym matplotlib -i https://pypi.tuna.tsinghua.edu.cn/simple 后面在PyCharm中报错显示找不到Gym模块。之后在“开始”菜单，找到Anaconda Powerfullshell Prompt打开。然后输入：pip install gym。解决Gym下载问题。 在PyCharm中配置Anaconda环境 In our case, we'll use pip. The fundamental building block of OpenAI Gym is the Env class. Next we install jypyter notebooks and create a kernel pointing to the gym environment created in the previous step: conda install jupyter nb_conda ipykernel python -m ipykernel install --user --name gym 创建环境conda create --name gymlab python=3.5注意官方不支持3.5以上的python; 安装gym依赖 apt-get install -y python-numpy python-dev cmake zlib1g-dev libjpeg-dev xvfb libav-tools xorg-dev … For gcc, I think it would be best if we have compiled wheels for gym dependencies. But directly doing $ pip install Box2D does not solve the issue. pip install -U gym Environments. 如何安装OpenGym. 折腾了好久，终于装上了。记录一下。 anaconda环境安装OpenGym. 查看已安装的环境： 或 创建新环境gymlab： 激活环境gymlab： 查看当前环境的python版本： 退出当前环境： 删除环境gymlab 在conda中安装gym： conda install gym gym-all gym-atari gym-box2d gym-classic_control gym-mujoco gym-robotics It is possible to list all of the versions of gym available on your platform with: conda search gym --channel conda-forge About conda-forge. One can either use conda or pip to install gym. Get code examples like "how to install gym in anaconda" instantly right from your google search results with the Grepper Chrome Extension. Conda support would be great, but I think we can get a lot of the benefit by making the pip install more reliable for everyone. 2.Install and Enable MuJoCo in Windows(optional): This step is only for those who want a full installation of Gym as OpenAI Gym does a minimal installation … C++ Build Tools. gym’s main purpose is to provide a large collection of environments that expose a common interface and are versioned to allow for comparisons.