Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Category vector
Food image converter
Take photoRendering Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photoRendering Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photoRendering Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photoRendering Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photoRendering Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photoRendering Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photoRendering
Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
1. Convert with high quality
2. Convert to multiple food category by one network
Category vector
Food image converter
Category Amount
Ramen 74,007
Curry rice 34,216
Fried rice 27,854
Fried noodle 24,760
Rice 21,324
Beef bowl 18,396
Chilled noodle 13,499
Meat spaghetti 7,138
Eel bowl 5,329
Buckwheat noodle 3,530
Total 230,053
Take photoRendering
Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photoRendering
Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photo
Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Rendering
Real world
Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Take photoRendering
Real world
Take photoRendering
Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photoRendering
Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Real world
Take photo
Server
HoloLens
Image+
category Convert Image
Convert to Camera
coordinates
Camera
Matrix
Convert to projected
coordinates
projection Matrix
Conditional
CycleGAN
U-Net
segmentation
Converted
Texture
Geometry shader
Triangular
polygonTexture UV
coordinate
Vertices in world
coordinates
Spatial mapping meshes
image
Convert to UV coordinates
And
Associate all vertices with texture
Rendering
Real world
Related Documents
