I tried to easily create a high-precision 3D image with one photo [0]. (Confirmed how to capture the space, put a net)

Overview

** One photo ** ** High-precision 3D image ↓ Easy creation **. github is below. https://github.com/vt-vl-lab/3d-photo-inpainting

Paper "3D Photography using Context-aware Layered Depth Inpainting" Meng-Li Shih1 and others are as follows. https://arxiv.org/pdf/2004.04727.pdf

Here, in order to confirm how to grasp the space,

  1. Calculate the depth of the original image
  2. From the state where the depth has already been calculated, put a ** grid ** in the original image and perform 3D processing.

The result is as follows. (The source of the still image before processing is https://pixabay.com/ja/)

⇒ ** I feel that the horizontal and vertical planes are well captured **.

Summary

** I think the point of the above github technology is in another place **, so this is a consideration of ** the base technology used there ** (beginners, interested in that) said).

The following are works that probably exceed the level of the author of github. A minor failure of technology was buried in the difficulty of separating pizza?

(Including the following related articles, the articles are listed in the order of [1] ⇒ [2] ⇒ [3] ⇒ 0.) If you have any comments, please let us know.

Relation

** Understand how to work in this article ** For more information, please refer to the following.

I tried to easily create a high-precision 3D image with one photo [1]. (Depth can now be edited in PNG.) I tried to easily create a high-precision 3D image with one photo [2]. (Try processing depth with numpy) I tried to easily create a high-precision 3D image with one photo [3]. Only depth without permission feat. Intel-isl.

Recommended Posts

I tried to easily create a high-precision 3D image with one photo [0]. (Confirmed how to capture the space, put a net)
I tried to easily create a high-precision 3D image with one photo [2]. (Try processing depth with numpy)
I tried to easily create a high-precision 3D image with one photo [3]. MiDaS of feat. Intel-isl only depth without permission.
How to easily create a CG image like a toy photo "Ubuntu / Linux" ・ Photo realistic rendering with LeoCAD & Blender
I tried to easily create a fully automatic attendance system with Selenium + Python
I tried to create a model with the sample of Amazon SageMaker Autopilot
I came up with a way to create a 3D model from a photo Part 02 Image loading and vertex drawing
I tried to move the 3D model by doing something like motion capture with just a laptop + webcam
I tried to create a table only with Django
How to create a submenu with the [Blender] plugin
I came up with a way to make a 3D model from a photo. 0 Projection to 3D space
Creating a highly accurate 3D image easily with one photo! (You can now edit the depth in PNG.) [1-E]
I tried to automatically create a report with Markov chain
I came up with a way to create a 3D model from a photo Part 04 Polygon generation
I tried using PI Fu to generate a 3D model of a person from one image
I tried to process the image in "sketch style" with OpenCV
I came up with a way to create a 3D model from a photo Part 01 Creating an environment
I wanted to solve the ABC164 A ~ D problem with Python
I tried to create Bulls and Cows with a shell program
I tried to process the image in "pencil style" with OpenCV
I tried to cut out a still image from the video
I tried to make a thumbnail image of the best avoidance flag-chan! With RGB values ​​[Histogram] [Visualization]
I tried to create a program to convert hexadecimal numbers to decimal numbers with python
I came up with a way to make a 3D model from a photo.
I tried to create a plug-in with HULFT IoT Edge Streaming [Development] (2/3)
I tried to create a plug-in with HULFT IoT Edge Streaming [Execution] (3/3)
[Outlook] I tried to automatically create a daily report email with Python
I tried to create a plug-in with HULFT IoT Edge Streaming [Setup] (1/3)
I tried to create a linebot (preparation)
I tried playing with the image with Pillow
I tried to create a class that can easily serialize Json in Python
When I tried to create a virtual environment with Python, it didn't work
I tried to easily visualize the tweets of JAWS DAYS 2017 with Python + ELK
I tried to extract a line art from an image with Deep Learning
I tried to create a button for Slack with Raspberry Pi + Tact Switch
I tried to make a simple image recognition API with Fast API and Tensorflow
I tried "smoothing" the image with Python + OpenCV
I want to easily create a Noise Model
I tried "differentiating" the image with Python + OpenCV
I tried to save the data with discord
I tried to correct the keystone of the image
How to create a multi-platform app with kivy
I tried to make it on / off by setting "Create a plug-in that highlights double-byte space with Sublime Text 2".
I made a plug-in from the Japan Meteorological Agency GPV to easily create an animated contour diagram with QGIS.
I tried to find out how to streamline the work flow with Excel x Python ②
I tried to make something like a chatbot with the Seq2Seq model of TensorFlow
I tried to find out how to streamline the work flow with Excel x Python ④
I tried to find out how to streamline the work flow with Excel x Python ⑤
I tried to put out the frequent word ranking of LINE talk with Python
I tried to create a reinforcement learning environment for Othello with Open AI gym
[Python] I tried to automatically create a daily report of YWT with Outlook mail
I tried to find out how to streamline the work flow with Excel x Python ①
How to make a 3D geometric figure with one click [From triangular pyramid to fractal]
How to test the current time with Go (I made a very thin library)
I tried to find out how to streamline the work flow with Excel x Python ③
I tried to create a class to search files with Python's Glob method in VBA
How to change the generated image of GAN to a high quality one to your liking
I tried scraping food recall information with Python to create a pandas data frame
The 15th offline real-time I tried to solve the problem of how to write with python
I tried to learn the sin function with chainer
Read the Python-Markdown source: How to create a parser