Blog

Mi2 Lab at EICS 2018

Several current and former members of the Information Interaction Lab contributed to two papers at the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS). Last year we had to miss out on EICS which was unfortunate as this has been a regular conference for the lab’s PI Michael Nebeling. This year, PhD student Brian Hall is going to represent us at EICS. Unfortunately, Michael is in conflict and will be at the ACM UIST program committee meeting instead. But, it’s going to be an exciting time for Brian. Not only will he present both papers, but it is also his first time in Europe. And, the conference is in Paris — ville d’amour. So show him some love at EICS! 🙂

The schedule of our presentations is as follows:

Wednesday, June 20th:

XD-AR: Challenges and Opportunities in Cross-Device Augmented Reality Application Development
Maximilian Speicher, Brian D. Hall, Ao Yu, Bowen Zhang, Haihua Zhang, Janet Nebeling, Michael Nebeling

Thursday, June 21st:

360Anywhere: Mobile Ad-hoc Collaboration in Any Environment using 360 Video and Augmented Reality
Maximilian Speicher, Jingchen Cao, Ao Yu, Haihua Zhang, Michael Nebeling (Presented by Brian D. Hall)

Mi2 Lab at CHI 2018

As announced previously, several members of the Information Interaction Lab have papers at CHI 2018. While last year three members of the lab were present, this year only Michael Nebeling is able to attend. Michael is always keen on meeting new people. This year he is particularly interested in talking to people that are considering doing a Postdoc after their PhD, or an internship to see if a PhD could be something. A research stay with us would allow you to explore exciting technical HCI domains, such as AR/VR, or gain more independent research experience in general and be involved in setting up a new lab such as ours. Please get in touch!

If you were interested in seeing some of our work, the schedule of our presentations is as follows:

Sunday all-day

Michael Nebeling is participating in the workshop Rethinking Interaction organized by Michel Beaudouin-Lafon and Wendy Mackay.

Tuesday 9:00-9:20 AM

Erin McAweeney is going to present our paper User-Driven Design Principles for Gesture Representations by Erin McAweeney (REMS fellow visiting from UW), Haihua Zhang (summer intern from Tsinghua), and Michael Nebeling.

Tuesday 12:00-12:20 PM

Michael Nebeling is going to present our paper GestureWiz: A Human-Powered Gesture Design Environment for User Interface Prototypes by Maximilian Speicher and Michael Nebeling.

Wednesday 9:40-10:00 AM

Michael Nebeling is going to present our paper ProtoAR: Rapid Physical-Digital Prototyping of Mobile Augmented Reality Applications by Michael Nebeling, Janet Nebeling, Ao Yu (summer intern from Tsinghua), and Rob Rumble.

Wednesday 4:00-5:20 PM

Michael Nebeling is going to be part of the Special Interest Group discussion on Redefining Natural User Interface with James Landay, Chen Zhao, and others from Alibaba.

We’ll publish the final versions of the papers on this web site soon after CHI 2018.

Josh Guberman joining as PhD student

We’re happy to announce that Joshua Guberman will enter the UMSI PhD program in Fall 2018, and will be working in the Information Interaction Lab as a research assistant. He will be advised by Michael Nebeling and Sile O’Modhrain.

Josh describes himself as a social-sciences researcher, a tinkerer/inventor, and a UI/UX enthusiast. He is a recent Illinois Tech graduate with a B.S. in Psychology. Josh is very passionate about accessibility and will help the lab explore new research avenues with accessibility as an important application domain. We’re excited about this, and look forward to him joining our lab and the UMSI community!

Rob Rumble joining as PhD student

We’re happy to welcome Rob Rumble as a PhD student in the Information Interaction Lab starting in Fall 2018. He will be advised by Michael Nebeling and Steve Oney.

Rob has already been working in the lab since Summer 2017, then joined the MSI program as a master’s student, and was recently accepted into the UMSI PhD program. This is an exciting switch and will allow Rob to spend more time on research.

Rob’s interests are in AR/VR. Over the last two semesters as a research assistant in the lab, he has worked on several smartphone-based AR projects, including ProtoAR which we will present at CHI 2018, and has also been exploring the potential of VR, and the ability to switch between AR and VR in an independent study project. We’re glad to have him as a PhD student in our lab!

AR/VR Courses starting in the Fall

We’re happy to announce that a new set of courses focused on AR/VR will be offered starting in the Fall 2018 semester. These and other courses we are teaching can also be found under Teaching.

First, there is an Intro to AR/VR (SI 559). We are currently working hard to make it accessible to the entire community at Michigan. While there is a number of students on the wait list, we will have to start small in the Fall semester. Based on this experience, our plan is to scale the course to larger student groups and perhaps multiple sections.

Second, there will be an Advanced AR/VR course. This course is targeted at more technical students interested in diving deeper into AR/VR interface development and content creation. Importantly, the Intro course is not a prerequisite for this course, though it is recommended. Prerequisites are SI 506 and SI 539, or similar courses, to make sure that students have a background in programming. Ideally, students would have experience with Three.js/A-Frame/JavaScript or Unity/C#.

Both courses will be taught by Professor Nebeling and will be supported by members of the Information Interaction Lab. We are working hard with various partners from industry, ranging from prototyping tool developers, to device manufacturers, to content providers. It will be a very exciting experience for us, and we hope you will be able to join us on this journey!

U-M Teach-Out on AR/MR/VR

Michael Nebeling and colleagues from U-M’s School of Information and the STAMPS School of Art and Design have put together a U-M Teach-Out on Augmented, Virtual, and Mixed Reality. The teach-out will be delivered in the form of an open-enrollment course on Coursera for free titled Augmented Reality, Virtual Reality, and Mixed Reality: Opportunities and Issues.

The course is a combination of discussion rounds, virtual lab tours, and an overview of relevant research and teaching at U-M. After one lecture introducing the different terminologies and technologies, the course features a series of discussions and expert panels on why these topics are extremely important and timely to talk about, and explores the impact on research and teaching as well as our daily lives, in a number of different domains, ranging from medicine and nursing, to landscaping and architectural design, to multimedia and entertainment.

We had a lot of fun creating this course and we hope you will be able to join us and participate in the discussion forums!

Google Daydream & Jump VR Pilot Programs

We are happy to announce that the Information Interaction Lab was selected as one of a few university labs to participate in two virtual reality (VR) pilot programs around Google Daydream and their Jump camera. These are two main VR initiatives by Google and we are happy to support them.

Daydream is a smartphone display wrapper with a tracked controller (like a wand) that turn an existing smartphone into a fully immersive headset. We already use Daydream in several of our research projects and so we are glad to participate in a broader pilot program to bring these technologies to campus and into classrooms.

What is of course also very exciting for the lab is that we have been selected as participants in Google Jump’s loan program. This is a highly sophisticated and expensive piece of equipment that we will install in the lab and use in various ongoing projects around AR/VR usability. Our current plan is to make use of this equipment specifically in a funded 12-week summer research position in our lab.

12-Week Paid Master’s Student Research Opportunities

The University of Michigan School of Information is hosting a 12-week intensive summer Research Experience for Master’s Students (REMS) from other iSchool master’s programs, schools of library and information science, or related programs, May 29–August 17, 2018.

Our lab is offering a project on AR/VR Usability Testing. You will work with UMSI professor Michael Nebeling in the Information Interaction Lab where we are investigating how multiple different types of devices can be combined and used in interesting ways to provide new interaction possibilities and enable tasks that are difficult to do using any of the devices alone. The project will focus on translating traditional methods and principles from user study design and usability testing to AR/VR usability. Depending on your interests, you could help with the development of new tools to support such studies, the design and evaluation of new kinds of AR/VR interfaces with a particular focus on usability testing, or both.

We hosted a REMS student last year. It was a very successful project and experience for both the student and the lab, which also resulted in a paper that will be presented by the student at CHI 2018.

Please check out more information on the REMS program and the AR/VR Usability Testing project. For project related questions, feel free to get in touch with Professor Nebeling directly.

Rapid Physical-Digital Prototyping with ProtoAR

We’ve just finished shooting a video summary illustrating some of the main features available in ProtoAR, our rapid prototyping tool for mobile augmented reality interfaces.

We created ProtoAR specifically for interaction designers. There are two key innovations in ProtoAR: (1) cross-device multi-layer authoring tools for live editing of mobile AR apps on phones; (2) interactive capture tools to generate mobile screens or AR overlays from paper sketches, and 3D models from Play-Doh. These are described in detail in our CHI 2018 paper.

We look forward to presenting the work at CHI 2018 in Montreal this April, and we have some more plans with ProtoAR. So stay tuned! For now, here is a preview of what one can do with ProtoAR: