skip to: page content | links on this page | site navigation | footer (site information)

 

favorite links

My research is on Human-Centered Computing (HCC). Over the past year or so I have focused on the following topics:

  • Human-Centered Business Intelligence: social network analysis using cognitive, socio-cultural, and contextual models, and visual analytics, particularly for exploring user models and behavioral trends.
  • Stream mining and collective intelligence for real-time applications.
  • Recommendation algorithms & personalization.

I am interested in understanding and formalizing HCC methodologies, which includes the design of “computing” systems and research processes, as well as understanding the relationship between various disciplines and the transfer of knowledge between them.

Copyright: the publications below are posted for personal use, not for redistribution.   This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder

Publications

2009

  •  “Data Mining Fundamentals for Recommender Systems,” book chapter in “Recommender Systems Handbook,” edited by P.B. Kantor, F. Ricci, L. Rokach, B. Shapira. (X. Amatriain, A. Jaimes. N. Oliver, J.M.Pujol) [Springer] (to appear)

  • “Data Mining for User Modeling and Personalization in Ubiquitous Environments”, book chapter in “Handbook of Ambient Intelligence and Smart Environments,” edited by H. Nakashima, J. C. Augusto, H. Aghajan. (A. Jaimes) [Springer] (in press)
  • “Computer Vision Interfaces for Interactive Art,¨ book chapter in “Human-Centric Interfaces for Ambient Intelligence,” edited by H. Aghajan, R. L.-C. Delgado, and J. C. Augusto. (A. Senior, A. Jaimes) [Elsvier] (in press).

2008

  • “A Study on the Granularity of User Modeling for Tag Prediction,” 2008 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2008), Sydney, Australia, December 2008. (E. Frías-Martinez, M. Cebrián, A. Jaimes) [PDF].
  • “The AMIDA Automatic Content Linking Device: Just-in-Time Document Retrieval in Meetings,” 5th Joint Workshop on Machine Learning and Multimodal Interaction (MLMI 2008), Utrecht, The Netherlands, September 2008. (A. Popescu-Belis, E. Boertjes, J. Kilgour, P. Poller, S. Castronovo, T. Wilson, A. Jaimes, J. Carletta) [PDF].
  • “Graphical Representation of Meetings on Mobile Devices,” 10th Intl. Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2008), Amsterdam, The Netherlands, September 2008. (L. Matena, A. Jaimes, A. Popescu-Belis) [PDF].
  • “Facial Expression Recognition as A Creative Interface”, International Conference on Intelligent User Interfaces (IUI 2008), Canary Islands, Spain, January 2008. (R. Valenti, A. Jaimes, N. Sebe) [PDF].

2007

  • "Recording, Indexing, Summarizing, and Accessing Meeting Videos: An Overview of the AMI Project," invited paper, 14th Intl. Conference on Image Analysis and Processing (ICIAP 2007) & Workshop on Visual and Multimedia Digital Libraries (VMDL 2007), Modena, Italy, Sept. 10-14, 2007. (A. Jaimes, H. Bourlard, S. Renals, and J. Carletta) [PDF].
  • "Human-Centered Computing: Toward a Human Revolution," IEEE Computer Magazine, guest editors' introduction, special issue on Human-Computer Computing. (A. Jaimes, D. Gatica-Perez, N. Sebe, and T.S. Huang) [PDF].
  • "Multimodal Human Computer Interaction: A Survey," Computer Vision and Image Understanding journal, Volume 108 ,  Issue 1-2, special issue on Human-Computer Interaction. (A. Jaimes and N. Sebe) [PDF].

2006

  • “Human-Centered Computing: A Multimedia Perspective,” ACM Multimedia 2006, Oct. 22-29, Augsburg, Barbara, CA, 2006. [PDF]
  • “Posture and Activity Silhouettes for Self-Reporting, Interruption Management, and Attentive Interfaces,” 2006 International Conference on Intelligent User Interfaces (IUI ’06), Sydney, Australia, Jan. 28-Feb. 1, 2006.  (A. Jaimes) [ PDF].
  • “Human Factors in Automatic Image Retrieval System Design and Evaluation”, invited paper, IS&T/SPIE Internet Imaging 2006. San Jose, CA, January 2006. (A. Jaimes) [ PDF].
  • "Moments of the Maiden: Time, Space, and Intercultural Communication in Tokyo,” After Midnight column, Leonardo Journal, Vol. 39, No. 2 (Spring 2006). (A. Jaimes) [ PDF] <due to copyright restrictions, this article cannot be posted on-line yet. Send me e-mail if you wish to obtain a copy>.
  • "Presence/Absence: The 2005 ACM Multimedia Interactive Art Exhibition” IEEE Multimedia Magazine (Spring 2006) (A. Jaimes) [ PDF].
  • “Human-Centered Multimedia: Culture, Deployment, and Access”, IEEE Multimedia Magazine (Spring 2006) (A. Jaimes) [ PDF].

2005

  • Interview on the state of e-content in Japan, in e-Content: Voices from the Ground (the Sequel) (Peter A. Bruck and Osama Manzar, editors), book published by Digital Empowerment Foundation and the World Summit Award Office, 2005. (A. Jaimes). [ PDF]
  • “Multimedia Information Retrieval: What it is, and why isn't anyone using it?” in ACM Multimedia Information Retrieval in conjunction with ACM Multimedia 2005 (MIR 2005), Singapore, Nov. 11, 2005. (A. Jaimes, M. Christel, S. Gilles, R. Sarukkai, and W.-Y. Ma) [ PDF]
  • “Sit Straight (and tell me what I did today): A Human Posture Alarm and Activity Summarization System,” 2nd ACM Workshop on Capture, Archival, and Retrieval of Personal Experiences in conjunction with ACM Multimedia 2005 (CARPE 2005), Singapore, Nov. 11, 2005. (A. Jaimes and J. Liu) [ PDF].
  • “A Component-Based Multimedia Data Model,” ACM Workshop on Multimedia for Human Communication - From Capture to Convey, in conjunction with ACM Multimedia 2005 (MHC 2005), Singapore, Nov. 12, 2005. (A. Jaimes) [ PDF].
  • "ACM Multimedia Interactive Art Program: An Introduction to the Absence/Presence Exhibition” ACM Multimedia 2005, Singapore, November 2005. (A. Jaimes, A. Senior, W. Muench) [PDF]
  • “A Knowledge-Based Model For Meeting Video Analysis,” 2nd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI 2005), Edinburgh, Scotland, July 11-13, 2005. (A. Jaimes) [ PDF] <see MHC article>
  • “On Human-Centered Multimedia”, Special Interest Group in Multimedia (SIGMM) website (http://www.sigmm.org/), May 2005. [go to article] <see IEEE Multimedia magazine article, which is an updated version>
  • "Configurable Hotspots for Ubiquitous Interaction," 7th International Conference on Ubiquitous Computing (ACM Ubicomp 2005), Tokyo, Japan, Sept. 11- 14, 2005. (A. Jaimes and J. Liu) [ PDF]
  • "Hotspot Components for Gesture-Based Interaction,” Interact 2005, Rome, Italy, Sept. 12-14, 2004. (A. Jaimes and J. Liu) [ PDF].
  • "Multimodal Human Computer Interaction: A Survey," invited paper, IEEE International Workshop on Human-Computer Interaction (HCI 2005) in conjunction with IEEE International Conference on Computer Vision (ICCV 2005), Beijing, China, Oct. 15-21, 2005. (A. Jaimes and N. Sebe) [ PDF]
  • "Affective Meeting Video Analysis," in IEEE ICME 2005, Amsterdam, The Netherlands, July 2005 (A. Jaimes, J. Liu, and N. Sebe) [ PDF]
  • "Building a Smart Meeting Room: From Infrastructure to the Video Gap (Research and Open Issues)," 1st IEEE International Workshop on Managing Data for Emerging Multimedia Applications (EMMA) in conjunction with 21th IEEE Conference on Data Engineering (ICDE) 2005. (A. Jaimes, and J. Miyazaki) [ PDF]

2004

  • "On the Image Content of a Web Segment- Chile as a Case Study" invited paper, International Journal of Web Engineering, 2004. (A. Jaimes, J. Ruiz-del-Solar, R. Verschae, R. Baeza-Yates, C. Castillo, E. Davis) [PDF]
  • "Digital Boundaries: The ACM Multimedia Interactive Art Program Exhibition," in IEEE Multimedia Magazine, Vol. 11, No. 4, Oct.-Dec., 2004 (A. Jaimes, P. Jennings, H. Ortega, M. Tribe, and C. Yang). [PDF]
  • "ACM Multimedia Interactive Art Program: An Introduction to the Digital Boundaries Exhibition” ACM Multimedia 2004, New York, NY, USA, October 2004. (A. Jaimes, P. Jennings) [PDF]
  • "Memory Cues for Meeting Video Retrieval” 1st ACM Workshop on Continuous Archival and Retrieval of Personal Experiences in conjunction with ACM Multimedia 2004, New York, NY, USA, October 2004. (A. Jaimes, K. Omura, T. Nagamine, and K. Hirata) [ PDF]
  • "A Visuospatial Memory Cue System for Meeting Video Retrieval” ACM Multimedia 2004, New York, NY, USA, October 2004. (T. Nagamine, A. Jaimes, K. Omura, K. Hirata) [ PDF]
  • "Visual Trigger Templates for Knowledge-Based Indexing " Fifth Pacific Rim Conference on Multimedia (PCM 2004), Tokyo, Japan, December 2004. (A. Jaimes, Q. Wang, N. Kato, H. Ikeda, and J. Miyazaki). [ PDF]
  • "Interactive Visualization of Multi-Stream Meeting Videos Based on Automatic Visual Content Analysis" IEEE International Workshop on Multimedia Signal Processing (MMSP '04), Siena, Italy, Sept. 2004. (A. Jaimes, N. Yoshida, K. Murai, K. Hirata, and J. Miyazaki). [PDF]

2003

  • "On the Image Content of the Web in Chile" 1st Latin American Web Conference, LA-Web. Santiago de Chile, November 12-12, 2003. (A. Jaimes, J. Ruiz-del-Solar, R. Verschae, D. Yaksic, Ricardo Baeza-Yates, E. Davis, C. Castillo)[abstract][PDF]
  • "Detection of Non-Identical Duplicate Consumer Photographs," invited paper, 4th IEEE Pacific Rim Conference on Multimedia, special session on Home Media Albums, Singapore, Dec. 15-18, 2003. (A. Jaimes, S.-F. Chang, and A.C. Loui) [abstract][PDF]
  • "Modal Keywords, Ontologies, and Reasoning For Video Understanding," International Conference on Image and Video Retrieval (CIVR 2003), Urbana, IL, July 24-25, 2003. (A. Jaimes, B. Tseng, and J.R. Smith). [ abstract][PDF]
  • "Technology for Education in Developing Countries- A Forward," proc. of ITRE International Conference on Research and Education; 1st International Workshop on Technology for Education in Developing Countrries, Newark, NJ, August 12, 2003. (A. Jaimes, Kinshuk, D. Sow) [ abstract] [ PDF]
  • "Semi-Automatic, Data-Driven Construction of Multimedia Ontologies," ICME 2003, Baltimore, USA, 2003. (A. Jaimes and J.R. Smith) [ abstract][PDF]
  • "Conceptual Structures and Computational Methods for Indexing and Organization of Visual Information," Ph.D. Thesis , Department of Electrical Engineering, Columbia University, February 2003. (Alejandro Jaimes) [PDF - 6.4 MB!!!]
  • "IBM Research TREC-2002 Video Retrieval System," TREC Video Retrieval Track, Washington D.C., 2003. (B. Adams, A. Amir, C. Dorai, S. Ghosal, G. Iyengar, A. Jaimes, C.L. Lang, C.-Y. Lin, A. Natsev, M. Naphade, C. Neti, H.J. Nock, H.H. Permuter, R. Singh, J.R. Smith, S. Srinivasan, B.L. Tseng, T.V. Ashwin, D. Zhang) [ PDF]
  • "Context Enhanced Video Understanding," SPIE Storage and Media Databases 2003, Santa Clara, California, January 2003. (Alejandro Jaimes, Milind Naphade, Belle Tseng, and John R. Smith) [ PDF]

2002

  • Duplicate Detection in Consumer Photography and News Video," ACM Multimedia 2002, Juan Les Pines, France, December 2002. (A. Jaimes, Shih-Fu Chang, and Alex C. Loui) [abstract] [PDF]
  • "Learning Personalized Video Highlights from Detailed MPEG-7 Event Metadata," IEEE International Conference on Image Processing (ICIP 2002), Rochester, NY, September 2002. (Alejandro Jaimes, Tomio Echigo, Masayoshi Teraguchi, and Fumiko Satoh) [abstract][Postcript][PDF]

2001

  • "Learning Structured Visual Detectors From User Input at Multiple Levels", invited paper, International Journal of Image and Graphics (IJIG), special issue on Image and Video Databases, August 2001 [Abstract] [PDF] (Alejandro Jaimes and Shih-Fu Chang)
  • "Improving Quality of Digital Images of Art in Museum Collections", IS&T Image Processing, Image Quality, Image Capture Systems Conference (PICS '01), Montreal, Canada, April 2001. [abstract] [PDF] (Alejandro Jaimes and Fred Mintzer)
  • "A Conceptual Framework and Research for Classifying Visual Descriptors", invited article, Journal of the American Society for Information Science (JASIS), special issue on "Image Access: Bridging Multiple Needs and Multiple Perspectives", summer 2001. (Corinne Jorgensen, Alejandro Jaimes, Ana B. Benitez, and Shi-Fu Chang) [abstract] [PDF]
  • "Using Human Observers' Eye Movements in Automatic Image Classifiers", IS&T/SPIE Human Vision and Electronic Imaging 2001. San Jose, CA, January 2001. (Alejandro Jaimes, Jeff Pelz, Tim Grabowski, Jason Babcock, and Shih-Fu Chang) [abstract][][PDF File]

2000

  • "Experiments in Indexing Multimedia Data at Multiple Levels", Idea Mart: Classification for User Support and Learning, ASIS SIG Classification Research Workshop. Chicago, IL, November 2000. (Alejandro Jaimes, Ana B. Benitez, Corinne Jorgensen, and Shih-Fu Chang) [Abstract][][PDF File]
  • Discovering Recurrent Visual Semantics in Consumer Photographs", invited paper, IEEE International Conference on Image Processing (ICIP 2000), special session on "Semantic Feature Extraction in Consumer Contents". Vancouver, Canada, September 10-13, 2000. (Alejandro Jaimes, Ana B. Benitez, Shih-Fu Chang, and Alexander C. Loui) [Abstract][][PDF File]
  • "Automatic Selection of Visual Features and Classifiers", Storage and Retrieval for Media Databases 2000, IS&T/SPIE. San Jose, CA, January 2000. (Alejandro Jaimes and Shih-Fu Chang) [abstract][full postscript file][PDF File]
  • "A Conceptual Framework for Indexing Visual Information at Multiple Levels", Internet Imaging 2000, IS&T/SPIE. San Jose, CA, January 2000. (Alejandro Jaimes and Shih-Fu Chang) [abstract][full postscript file][PDF File]
  • "Integrating Multiple Classifiers in Visual Object Detectors Learned from User Input", invited paper, session on Image and Video Databases, 4th Asian Conference on Computer Vision (ACCV 2000), Taipei, Taiwan, January 8-11, 2000. [abstract][full postscript file][PDF File] (Alejandro Jaimes and Shih-Fu Chang)

1999

  • Model-Based Classification of Visual Information for Content-Based Retrieval", Storage and Retrieval for Image and Video Databases VII, 1999, IS&T/SPIE. San Jose, CA, January 1999. (Alejandro Jaimes and Shih-Fu Chang) [abstract][full postscript file][PDF File]
  • "Segmentation and Automatic Descreening of Scanned Documents", Color Imaging: Device-Independent Color, Color Hardcopy, and Graphic Arts IV, 1999, IS&T/SPIE. San Jose, CA, January 1999. (Alejandro Jaimes, Frederick Mintzer, A. Ravishankar Rao and Gerhard Thompson) [abstract]][full postscript file][PDF File]
  • "Digital Stereoscopic Imaging", Stereoscopic Displays and Applications X, 1999, IS&T/SPIE. San Jose, CA, January 1999. (A. Ravishankar Rao and Alejandro Jaimes) [abstract][full postscript file][PDF File]
  • "Integration of Visual and Text-Based Approaches for the Content Labeling and Classification of Photographs", ACM SIGIR 99, Workshop on Multimedia Indexing and Retrieval, University of California, Berkeley, August 15-19, 1999.(Seungyup Paek, Carl L. Sable, Vasileios Hatzivassiloglou, Alejandro Jaimes, Barry H. Schiffman, Shih-Fu Chang, and Kathleen McKeown) [full postscript file][PDF File]

MPEG-7 Contributions (see Columbia MPEG-7 page for information on MPEG-7)

  • "Report of CE on Multilevel Indexing Pyramid", ISO/IEC JTC1/SC29/WG11 MPEG00/M6495, La Baule, France, Oct. 2000.
    (Document: PDF, ZIP; Presentation: PDF, ZIP) (A. B. Benitez, A. Jaimes, C. Jorgensen, S.-F. Chang)
  • "Report of CE on Structured Textual Description", ISO/IEC JTC1/SC29/WG11 MPEG00/M6240, Beijing, China, July 2000.
    (Document: PDF, ZIP; Presentation: PDF, ZIP)(M. Shibata, A. Tam, C. Leung, K. Hasida, A. Benitez, A. Jaimes)
  • "Multiple Level Classification of Audio Descriptors", ISO/IEC JTC1/SC29/WG11 MPEG00/M6114, Geneva, Switzerland, May/June 2000.
    (Document: PDF, ZIP; Presentation: PDF, ZIP)(A. Jaimes, A. B. Benitez, S.-F. Chang)
  • "Report of CE on Multi-Level Indexing Pyramid", ISO/IEC JTC1/SC29/WG11 MPEG00/M6113, Geneva, Switzerland, May/June 2000.
    (Document: PDF, ZIP; Presentation: PDF, ZIP)(A. Jaimes, C. Jorgensen, A. B. Benitez, S.-F. Chang)
  • "Experiments for Multiple Level Classification of Visual Descriptors", ISO/IEC JTC1/SC29/WG11 MPEG99/M5593, Maui, Hawaii, USA, Dec. 1999.
    (Document: PDF, ZIP; Presentation: PDF, ZIP)(A. Jaimes, C. Jorgensen, A. B. Benitez, S.-F. Chang)
  • "Multiple Level Classification of Visual Descriptors in the Generic AV DS", ISO/IEC JTC1/SC29/WG11 MPEG99/M5251, Melbourne, Australia, Oct. 1999.
    (Document: PDF, ZIP; Presentation: PDF, ZIP)(A. Jaimes, C. Jorgensen, A. B. Benitez, S.-F. Chang)
  • "Fundamental Entity-Relation Models for the Generic Audio Visual DS", Contribution to ISO/IEC JTC1/SC29/WG11 MPEG99/M4754, Vancouver, Canada, July 1999.
    (Document: PDF, ZIP; Presentation: PDF, ZIP)(A. B. Benitez, A. Jaimes, S.-F. Chang, J. R. Smith, C.-S. Li)
  • "Fundamental Entity-Relation Models for a Multimedia Archive DS", Contribution to ISO/IEC JTC1/SC29/WG11 MPEG99/M4755, Vancouver, Canada, July 1999.
    (Document: PDF, ZIP; Presentation: PDF, ZIP)(A. B. Benitez, A. Jaimes, S. Paek, S.-F. Chang)