Toyohashi University of Technology
Department of Computer Science and Engineering

Style-Based Retrieval of Illustrations

Retrieval, classification, and ranking methodologies based on the drawing styles of illustrative images. The intuitive and automatic conversions and transformations of style are also investigated for both raster and vector images.

An Unsupervised Approach for Comparing Styles of Illustrations, CBMI2015

From illustrative image to optical signals

Smart image conversion technique is developed by using color mapping based on color enhancement method and perceptual experiment.

Perceptual Color Enhancement for LED Illuminations

Font image conversion for machine embroidery

Smart image conversion for embroidery of Kanji-character is developed using SOTA of DNN technologies, which tries to imitate the aesthetic expressions created by skilled craftsman.

Perceptual metric for down-scaled illustrations

New perceptual metric is developed for estimating image quality of down-scaled illustrative images, which is useful in obtaining icons or pixel arts by down-sampling illustrative images.

Estimation of lighting colors

An image analysis technique was developed for estimating the colors of multiple lighting illuminating the scenes from a single image, by introducing color-line theory.

Estimation of Multiple Illuminant Colors Using Color Lines of Single Image

Lighting controls for impressive portrait

The image-based monitoring and controls with mobile lighting robot is developed, by analyzing the lighting conditions from a portrait image.

Shade Analysis on Facial Images for Robotic Lighting

Restoration of lighting colors

An image synthesis technique was developed for authentically restoring the color of indoor scenes illuminated with color lighting systems. HDR images are smartly converted on the basis of the color appearance model of human vision system.

Restoration of color appearance by combining local adaptations for HDR images, AIC2015

Image-based multiple lighting controls with a Web interface

Smart lighting methodologies was developed with sensor-attached digitally-controllable color LED unit. The smart and energy-saving dimming control is implemented by introducing an intrinsic image analysis and a Web-based control interface.

Ubiquitous communications via optical spatio-temporal data processing

The pattern recognition technique for optical variations along space and time is explored with image sensors of commercial smartphones or handy mobile devices such as tablets or smart watches. Data communication systems with color LEDs are developed as an application of this optical pattern recognitions.

Data-Embeddable Texture Synthesis

A method of synthesizing texture images was developed for embedding arbitrary data. It introduces the smart techniques of generating repetitive texture patterns through feature learning of a sample image. A synthesized image can effectively conceal the embedded pattern, and the pattern can be robustly detected from a photographed image of mobile devices such as smart phones and tablets.
Texture Synthesis for Mobile Data Communications, IEEE Computer Graphics and Applications

Smart Skin Deformations

We have developed an efficient method of deforming human skin by skeletal motions, by introducing state-of-the-art sparsity model called Nuclear Norm minimization.
This project utilizes this model for interactive classification and synthesis of motion data.
Efficient Dynamic Skinning with Low-Rank Helper Bone Controllers, ACM Transactions on Graphics (SIGGRAPH 2016)

Pose-Timeline for Propagating Motion Edits

A motion editing interface was developed for efficiently and flexibly editing the sequence of iterative actions by a few intuitive operations. It can visualize a motion sequence on a summary timeline with editable pose-icons, and drag-and-drop operations on the timeline enable intuitive controls of temporal properties of the motion such as timing, duration, and coordination.
Pose-Timeline for Propagating Motion Edits, Symposium on Computer Animation (SCA 2009)
keyword: pose-timeline, edit propagation, motion re-timing, motion style transfer

Multilinear Motion Synthesis with Level of Detail Controls

A hybrid algorithm was developed to optimize the reduction size and computational time, according to the distance from the camera while maintaining visual quality. It can provide a practical tool for creating an interactive animation of many characters while ensuring accurate and flexible controls at a modest level of computational cost.
Multilinear motion synthesis with level-of-detail controls, Pacific Graphics 2007
keyword: motion interpolation, multilinear analysis, level-of-detail control

Geostatistical Motion Interpolation

Motion interpolations were developed with statistical predictions of missing data in an arbitrarily definable parametric space. A practical technique of geostatistics, called universal kriging, was introduced for statistically estimating the correlations between the dissimilarity of motions and the distance in the parametric space. It can statistically optimize interpolation kernels for given parameters at each frame, using a pose distance metric to efficiently analyze the correlation.
Geostatistical Motion Interpolation, ACM Transactions on Graphics (SIGGRAPH 2005)
SIGGRAPH demo movie
keyword: motion interpolation, geostatistics, kriging, variogram

Autonomous, Explorative Motion Generation

Explorative synthesis of human motions was developed using hierarchical re-inforcemant learning for searching plausible poses with end-effector's constraints.

keyword: keyframe animation, hierarchical reinforcement learning

Neural Gait Generator

Coupled neural cell models was introduced for generating oscillation signals to synthesize various gait motions that are self-stabilizable for dynamical environment.

keyword: neural oscillator, central pattern generator (CPG)

Smart Manipulations of Massive Motion Data

Self-organizing map was introduced to visualize massive motion capture data while interactively retrieving motion clips with this map.

keyword: motion clip retrieval, self organizing map (SOM)

Generating Concise Rules for Retrieving Human Motions from Large Datasets

A method for retrieving human motion data was developed with concise retrieval rules based on the spatio-temporal features of motion appearance. It converts motion clip into a form of clause language that represents geometrical relations between body parts and their temporal relationship. A retrieval rule is then learned from the set of manually classified examples using inductive logic programming.
Generating Concise Rules for Retrieving Human Motions from Large Datasets, Computer Animation and Social Agents (CASA2009)
keyword: motion retrieval, inductive logic programming, appearance feature

Psychology-based Crowd Simulation

A gait simulation was developed based on psychological model of personal space and group intelligence for very crowded environment.

Psychological Model for Animating Crowded, Computer Animation and Virtual Worlds (Special issue CASA 2005)

keyword: crowded pedestrian, psychological model, personal space, virtual memory, locomotion graph

Web-based Behavior Simulation

A Web-based system for simulating human behaviors was developed with motion capture data and XML-based scenario of behaviors. Java-based middleware was developed with the financial support by Mitou software project of IPA.

keyword: web3D, xml, simulation middleware