Pages

Wednesday, March 13, 2013

Updates on LIRE (SVN rev 39)

Article from http://www.semanticmetadata.net/
Author:Mathias Lux

LIRE is not a sleeping beauty, so there’s something going on in the SVN. I recently checked in updates on Lucene (now 4.2) and Commons Math (now 3.1.1). Also I removed some deprecation things still left from Lucene 3.x.

Most notable addition however is the Extractor / Indexor class pair. They are command line applications that allow to extract global image features from images, put them into an intermediate data file and then — with the help of Indexor — write them to an index. All images are referenced relatively to the intermediate data file, so this approach can be used to preprocess a whole lot of images from different computers on a network file system. Extractor also uses a file list of images as input (one image per line) and can be therefore easily run in parallel. Just split your global file list to n smaller, non overlapping ones and run n Extractor instances. As the extraction part is the slow one, this should allow for a significant speed-up if used in parallel.

Extractor is run with

$> Extractor -i <infile> -o <outfile> -c <configfile>



  • <infile> gives the images, one per line. Use “dir /s /b *.jpg > list.txt” to create a compatible list on Windows.


  • <outfile> gives the location and name of the intermediate data file. Note: It has to be in a folder parent to all images!


  • <configfile> gives the list of features as a Java Properties file. The supported features are listed below the post. The properties file looks like:
    feature.1=net.semanticmetadata.lire.imageanalysis.CEDD
    feature.2=net.semanticmetadata.lire.imageanalysis.FCTH
    …

Indexor is run with

Indexor -i <input-file> -l <index-directory>



  • <input-file> is the output file of Extractor, the intermediate data file.


  • <index-directory> is the directory of the index the images will be added (appended, not overwritten)

Features supported by Extractor:



  • net.semanticmetadata.lire.imageanalysis.CEDD


  • net.semanticmetadata.lire.imageanalysis.FCTH


  • net.semanticmetadata.lire.imageanalysis.OpponentHistogram


  • net.semanticmetadata.lire.imageanalysis.JointHistogram


  • net.semanticmetadata.lire.imageanalysis.AutoColorCorrelogram


  • net.semanticmetadata.lire.imageanalysis.ColorLayout


  • net.semanticmetadata.lire.imageanalysis.EdgeHistogram


  • net.semanticmetadata.lire.imageanalysis.Gabor


  • net.semanticmetadata.lire.imageanalysis.JCD


  • net.semanticmetadata.lire.imageanalysis.JpegCoefficientHistogram


  • net.semanticmetadata.lire.imageanalysis.ScalableColor


  • net.semanticmetadata.lire.imageanalysis.SimpleColorHistogram


  • net.semanticmetadata.lire.imageanalysis.Tamura

Monday, March 11, 2013

M.I.T. Computer Program Reveals Invisible Motion in Video

A team of scientists at the Massachusetts Institute of Technology has developed a computer program that reveals colors and motions in video that are otherwise invisible to the naked eye.

Read More

Sunday, March 10, 2013

Visual Information Retrieval using Java and LIRE

Synthesis Lectures on Information Concepts, Retrieval, and Services
January 2013, 112 pages, (doi:10.2200/S00468ED1V01Y201301ICR025)
Mathias Lux (Alpen Adria Universität Klagenfurt, AT)
Oge Marques (Florida Atlantic University, USA)

Abstract. Visual information retrieval (VIR) is an active and vibrant research area, which attempts at providing means for organizing, indexing, annotating, and retrieving visual information (images and videos) from large, unstructured repositories.

The goal of VIR is to retrieve matches ranked by their relevance to a given query, which is often expressed as an example image and/or a series of keywords. During its early years (1995-2000), the research efforts were dominated by content-based approaches contributed primarily by the image and video processing community. During the past decade, it was widely recognized that the challenges imposed by the lack of coincidence between an image’s visual contents and its semantic interpretation, also known as semantic gap, required a clever use of textual metadata (in addition to information extracted from the image’s pixel contents) to make image and video retrieval solutions efficient and effective. The need to bridge (or at least narrow) the semantic gap has been one of the driving forces behind current VIR research. Additionally, other related research problems and market opportunities have started to emerge, offering a broad range of exciting problems for computer scientists and engineers to work on.

In this introductory book, we focus on a subset of VIR problems where the media consists of images, and the indexing and retrieval methods are based on the pixel contents of those images — an approach known as content-based image retrieval (CBIR). We present an implementation-oriented overview of CBIR concepts, techniques, algorithms, and figures of merit. Most chapters are supported by examples written in Java, using Lucene (an open-source Java-based indexing and search implementation) and LIRE (Lucene Image REtrieval), an open-source Java-based library for CBIR.

http://www.morganclaypool.com/doi/abs/10.2200/S00468ED1V01Y201301ICR025

Saturday, March 9, 2013

Automatic Summarization and Annotation of Videos with Lack of Metadata Information

My latest accepted article - Expert Systems with Applications (In Press)

Authors: Dim P. Papadopoulos, Vicky S. Kalogeiton, Savvas A. Chatzichristofis, Nikos Papamarkos

Untitled - 2

The advances in computer and network infrastructure together with the fast evolution of multimedia data has resulted in the growth of attention to the digital video’s development. The scientific community has increased the amount of research into new technologies, with a view to improve the digital video utilization: its archiving, indexing, accessibility, acquisition, store and even its process and usability. All these parts of the video utilization entail the necessity of the extraction of all important information of a video, especially in cases of lack of metadata information. The main goal of this paper is the construction of a system that automatically generates and provides all the essential information, both in visual and textual form, of a video. By using the visual or the textual information, a user is facilitated on the one hand to locate a specific video and on the other hand is able to comprehend rapidly the basic points and generally, the main concept of a video without the need to watch the whole of it. The visual information of the system emanates from a video summarization method, while the textual one derives from a key-word-based video annotation approach. The video annotation technique is based on the key-frames, that constitute the video abstract and therefore, the first part of the system consists of the new video summarization method. According to the proposed video abstraction technique, initially, each frame of the video is described by the Compact Composite Descriptors (CCDs) and a visual word histogram. Afterwards, the proposed approach utilizes the Self-Growing and Self-Organized Neural Gas (SGONG) network, with a view to classifying the frames into clusters. The extraction of a representative key frame from every cluster leads to the generation of the video abstract. The most significant advantage of the video summarization approach is its ability to calculate dynamically the appropriate number of final clusters. In the sequel, a new video annotation method is applied on the generated video summary leading to the automatic generation of key-words capable of describing the semantic content of the given video. This approach is based on the recently proposed N-closest Photos Model (NCP). Experimental results on several videos are presented not only to evaluate the proposed system but also to indicate its effectiveness.

http://www.sciencedirect.com/science/article/pii/S0957417413001322

Tuesday, February 26, 2013

This Amazing 3-D Desktop Was Born at Microsoft

Article from wired.com

LONG BEACH, California – The history of computer revolutions will show a logical progression from the Mac to the iPad to something like this SpaceTop 3-D desktop, if computer genius Jinha Lee has anything to say about it.

The Massachusetts Institute of Technology grad student earned some notice last year for the ZeroN, a levitating 3-D ball that can record and replay how it is moved around by a user. Now, following an internship at Microsoft Applied Science and some time off from MIT, Lee is unveiling his latest digital 3-D environment, a three-dimensional computer interface that allows a user to “reach inside” a computer screen and grab web pages, documents, and videos like real-world objects. More advanced tasks can be triggered with hand gestures. The system is powered by a transparent LED display and a system of two cameras, one tracking the users’ gestures and the other watching her eyes to assess gaze and adjust the perspective on the projection.

Lee’s new 3-D desktop, which he just showed off at the annual TED conference in Long Beach, California, is still in the early stages. But it lights the way toward the sort of quantum leap that’s all too rare in computer interfaces. It took decades to get from the command-line interface to the graphical user interface and Apple’s Macintosh. It took decades more to get from the Mac to the touch interface of iPhones and iPads. Lee and people like him might just get us to the next revolution sooner.

Others are working along similar lines. Gesture-based control has been incorporated into Microsoft’s Kinect, Samsung’s Smart TV platform, and products from startups like Leap Motion and SoftKinect (not to mention in cinema fantasyland ). Three dimensional display interfaces, meanwhile, have been brewing at the University of Iowa (home to “Leonar3Do” ), in the Kickstarter gaming

Read more

Augmented Reality SDK for App Development

Develop native Augmented Reality applications for IOS, Android and Windows deployment using the metaio SDK. The metaio SDK includes a powerful 3-D rendering engine in addition to plug-ins for Unity. Create your own application once, using the metaio SDK and deploy to all major operating systems and devices via AREL, the Augmented Reality Experience Language. Take advantage of the advance tracking features, such as Markerless 2-D and 3-D Tracking, client-based visual search and SLAM. There are no hidden fees, costs, or extra plug-ins necessary to get started... The metaio SDK is the best value fo AR developer's solutions on the market!