Visual surveillance produces a significant amount of raw video data that can be time consuming to browse and analyze. In this work, we present a video synopsis methodology called “scene adaptive online video synopsis via dynamic tube rearrangement using octree (SSOcT)” that can effectively condense input surveillance videos. Our method entailed summarizing the input video by analyzing scene characteristics and determining an effective spatio-temporal 3D structure for video synopsis. For this purpose, we first analyzed the attributes of each extracted tube with respect to scene geometry and complexity. Then, we adaptively grouped the tubes using an online grouping algorithm that exploits these scene characteristics. Finally, the tube groups were dynamically rearranged using the proposed octree-based algorithm that efficiently inserted and refined tubes containing high spatio-temporal movements in real time. Extensive video synopsis experimental results are provided, demonstrating the effectiveness and efficiency of our method in summarizing real-world surveillance videos with diverse scene characteristics.

Here we present a projection augmented reality (AR) based assistive robot, which we call the Pervasive Assistive Robot System (PARS). The PARS aims to improve the quality of life by of the elderly and less able-bodied. In particular, the proposed system will support dynamic display and monitoring systems, which will be helpful for older adults who have difficulty moving their limbs and who have a weak memory.We attempted to verify the usefulness of the PARS using various scenarios. We expected that PARSs will be used as assistive robots for people who experience physical discomfort in their daily lives.

Projection-based augmented reality (AR) has much potential, but is limited in that it requires burdensome installations and prone to geometric distortions on display surface. To overcome these limitations, we propose AIR. It can be carried and placed anywhere to project AR using pan/tilting motors, while providing the user with distortion-free projection of a correct 3D view.

Many kinds of preparations are needed when meeting. For example, projector, laptop, cables and ETC. As such, this video have constructed Meet AR-bot, which helps users to keep meeting going smoothly, based on the projection of Augmented Reality(AR). Our system can easily provide meeting room environment through the movable setting via wheel-based stand. Users do not need to carry a personal laptop and connect them to the projector. Robot reconstructs the 3D geometry information through pan-tilt system and compute projection areas to project information in the space. Users can also control through mobile devices. We offer presentation, table interaction, file sharing and virtual object registration by mobile device.

Video conferencing, which helps gather opinions and make decisions quickly among employees who are not in the same location, is now a very important communication tool in the workplace. Our research is one of these video conferencing solutions, specifically proposed to address the difficulties of analog materials sharing and feedback, and has added some useful features for the smooth use of conference participants. We conducted a comparative experiment on our proposed method of file sharing and the method that we had previously used in video conferencing. As a result, the proposed system yielded better results in terms of time and usability during a full-scale collaborative situation in which feedback was provided.

Children encounter a variety of experiences through play, which can improve their ability to form ideas and undergo multi-faceted development. Using Augmented Reality (AR) technology to integrate various digital learning elements with real environments can lead to increased learning ability. This study proposes a 360° rotatable and portable system specialized for education and development through projection-based AR play. This system allows existing projection-based AR technology, which once could only be experienced at large-scale exhibitions and experience centers, to be used in individual and small-scale spaces. It also promotes the development of multi-sensory abilities through a multi-modality which provides various intuitive and sensory interactions. By experiencing the various educational play applications provided by the proposed system, children can increase their physical, perceptive, and emotional abilities and thinking skills.

An estimated 20 percent of the world»s population experience difficulties with physical, cognitive and mental health. Senior citizens experience many inconveniences due to less memory and mobility as a function of the aging process. To solve this, the cARe-bot system was designed to dynamically provide optimal information in the actual environment at any time or place. It is also designed to increase an elder person»s ability to live in a house or in senior homes with daily support, thus establishing the convenience and comfort they knew throughout their lives. The hardware of this system is a 360-degree controllable projection system. It is made with a pan-tilt system, projector, and a depth-recognition camera. Arduino is attached in order to control two sets of servo-motors, and is connected to a PC, which controls the entire process.

We present a method to assist pre-touch on multi touch surfaces using features extracted from the fingertips of the user's hands. Pixel area a feature obtained from the contour of a fingertip is computed and tracked using commodity cameras to obtain the velocity of approaching fingers. We target sound volume control for digital multi-touch instruments an area where pre-touch is demonstrated with our approach to approximating velocity of finger taps. We explore other areas of application with velocity and how it can help anticipate user actions in mobile touch displays. In order to evaluate the effectiveness of the proposed system, a system prototype was presented to users. We confirmed the satisfactory results by performing the recognition rate experiment for measuring the blob size according to the touch speed.

With the development of digital technology, many researchers increasingly study projection-based augmented reality (AR) that recognizes surrounding space, considers users' situation and provides space-oriented information rather than merely providing simple, fragmentary information. However, complicated installation issues persist, such as projection system installation and space setup to provide projection under various environments. In this study, we propose a portable, ambient projection system to address such complex installation issues. We defined pervasive projection AR system that enables projection in various spaces. The system consists of a pico-projector, a depth-sensing camera, and a pan/tilting platform that supports the projector-camera system. The portable ambient projection system can be positioned at an unknown space and can extract plane information by scanning its surrounding environment as it rotates 360-degrees in a clockwise manner. Users are provided with a pervasive projection AR environment as with a simple tablet user interface to control it.

객체 인식 기술은 컴퓨터 비전 기반 어플리케이션에서 다양하게 사용된다. 본 논문은 급격히 변화하는 환경에서 객체 인식을 위한 실시간 특징점 기반 추적 기법과 포즈 예측 방법에 대해 제안하고자 한다. 실시간 객체 추적을 위한 연구는 이전부터 많이 진행되어 왔지만, 급격한 영상 변화 등 복잡한 환경에서는 아직 개선해야 할 부분들이 존재한다. 이에, 본 논문은 특징점 필터링, 하이브리드 구조 기반의 온라인 학습의 2단계로 구성하여 연구를 진행하였다. 특징점 필터링 단계는 강인한 추적을 위해 특징점 매칭 이전에 수행되는 단계로, 추출된 특징점의 공간적 분포와 질을 고려하여 특징점을 추출한다. 하이브리드 구조기반의 온라인 학습 단계에서는 강인한 포즈인식을 위해 Structured support vector machine (SSVM) 기반 러닝 기법을 적용하였다. 제안하는 시스템의 성능 검증을 위해, 공용 DB 와 자체제작 DB를 포함한 총 13개의 비디오를 사용하여 다양한 검출기-서술자 기반의 성능검증 실험을 진행하고, 최신 연구와의 비교실험을 통해 만족할만한 성능을 확인하였다.

We propose a realtime plane detection method for projection-based Augmented Reality (AR) system in an unknown environment. While previous works usually designate space, the plane detection method automatically detects multiple planes based on the proposed constrained sampling strategy in RAndom SAmpleing Concensus (RANSAC). For each plane, an area for projection is selected for contents while considering occlusions by other objects. In addition, when the multiple planes are detected, the importance for contents is measured by the score functions based on the properties of planes such as size, color, and position. The proposed method can guide users to select plane for projection by visualizing the importances, or can automatically select a plane according to the users. We achieves a significant improvement in speed (about 260 times faster than the RANSAC) and high precision. These technique has become widely utilized in various AR applications such as AR game, and etc.

In this paper, a new object manipulation method is proposed by applying the ray's depth information to the ray-casting-based interface. Ray-casting has been widely used in handheld device interfaces for manipulating objects in three-dimensional (3D) space, such as augmented reality or virtual reality environments. However, the traditional ray-casting interface has limited object manipulation because it cannot designate a specific location in 3D space; it also has poor accuracy in manipulating objects at far distances. In this study, a user could register the virtual object in the real 3D space by specifying the arbitrary position using ray-depth information. We also improved the virtual object manipulation accuracy of the ray-casting interface by compensating the sensitivity according to the distance between the user and the object. To verify the manipulation accuracy of the interface implemented with the proposed technology, this study conducted a comparative experiment with existing interfaces. This verified the performance improvement in 3D space.

This research paper proposes a system for interior design prototyping based on portable-type projection-based AR (Augmented Reality). The DIY (do it yourself) interior designing process takes much time, monetary resources and labor. To overcome such difficulties, many research studies in the have been undertaken in the field of AR. Among those studies, projection-based AR technology provides users virtual information that is very real by projecting new digital information onto things and spaces. Most of those studies employing projection-based AR technology have been carried out in predefined spaces. In this paper, a projection-based AR system that can be used to design interiors of non-predefined spaces was proposed. This DesignAR system can effectively design interiors, even in the spaces not predefined by a 3D map of the space. Also, by connecting with mobile devices, the system raises the user's degree of freedom due to the interface usability, mobility and overall convenience. In order to evaluate the effectiveness of the proposed system, we set up a scenario for interior design prototyping. A usability evaluation was conducted by questionnaire after users performed tasks based on a preset scenario.

This paper presents a mobile-based real-time information providing system with augmented reality, called Smart Advisor. Smart Advisor can make users' life convenient by informing necessary information and actions in advance by recognizing and tracking the interest object captured by the camera in mobile devices. Specifically, the proposed system will be helpful to the elderly/disabled users with vulnerable decision-making ability. For robust recognition in various environments, an object matching technique based on binary descriptors is applied with adaptive illumination compensation in limited search window. Then, the camera pose is reliably estimated by RANSAC and inverse-homography calculation. This system can be applicable to various areas, such as medical treatment, education, and game through the interlocking with the Internet of Things (IoT).

Augmented reality (AR) is widely used in various applications of computer vision, such as marker-based AR and markerless-based AR. These AR techniques are used in various fields, including industry, education, and medicine. Using marker-based AR, employees can easily perform step-by-step maintenance and repairs, and they can register parts information for large plants. However, conventional marker-based AR relies on a relatively small number of recognizable IDs compared to barcode markers. In this paper, to address the insufficient identification volume in conventional AR systems, we integrate barcode-based code technology with marker-based AR technology. Based on the results of an experiment, we applied ColorCode to our marker-based AR system. Nevertheless, difficulties arise when applying ColorCode to an AR system, owing to its recognition distance and relatively small size, compared to other AR codes. In this paper, therefore, we complemented quad detection with a tracking technique for various angles and distances, facilitating reliable recognition of the color-code-based AR system, Moreover, we added a tracking module to address the system's failure to detect markers. The experimental results demonstrate that the proposed system offers stable recognition.

The proposed system is a user-friendly interactive Augmented Reality Authoring System, which is for users with basic knowledge of augmented reality or without programming skills. The user can wear the head-mounted display and easily create AR content by using sensors on mobile devices. The user can also directly apply a variety of methods to interact with the AR content. Interaction with the AR content is enabled by using the user's hand, which is recognized by the camera attached to the HMD, and the mobile device's sensor data. In order to evaluate the effectiveness of the proposed system, a system prototype was presented to users. A usability test was conducted with regard to AR content production and interactive tasks.

This paper proposes an augmented reality content authoring system that enables ordinary users who do not have programming capabilities to easily apply interactive features to virtual objects on a marker via gestures. The purpose of this system is to simplify augmented reality (AR) technology usage for ordinary users, especially parents and preschool children who are unfamiliar with AR technology. The system provides an immersive AR environment with a head-mounted display and recognizes users' gestures via an RGB-D camera. Users can freely create the AR content that they will be using without any special programming ability simply by connecting virtual objects stored in a database to the system. Following recognition of the marker via the system's RGB-D camera worn by the user, he/she can apply various interactive features to the marker-based AR content using simple gestures. Interactive features applied to AR content can enlarge, shrink, rotate, and transfer virtual objects with hand gestures. In addition to this gesture-interactive feature, the proposed system also allows for tangible interaction using markers. The AR content that the user edits is stored in a database, and is retrieved whenever the markers are recognized. The results of comparative experiments conducted indicate that the proposed system is easier to use and has a higher interaction satisfaction level than AR environments such as fixed-monitor and touch-based interaction on mobile screens.