Educational AR popup for XRD Lecture 2

The first lecture was spent to give an overall overview of the course and its process. This lecture was then spent on lab hours. Therefor the group started to work on the given project of this week, which is a simple application running an AR program. 

AR (Augmented Reality) is sort of technology that allows the user to experience real world interaction together with computer generated objects. These can be simple as small character that jump around on your phone and interact with the ground such as pokemonGO to more complex objects such a fully interactive screen of wiring. 

Our idea for an AR application would be an enhancement for children's book that would allow children to more deeply experience of what they are reading. Allowing them to get a better understand whilst also making it fun to read. The theory behind it is simply to create readable assets in the book which the children can scan with their phones, from which the scanned assets then creates what they wanna see. 

The implementation itself is done via the game creating software called unity and its AR unity package that allows for simple game-object orientated instantiations of the virtual objects. Together with this AR Unity also allows one to apply photo access via a connected video camera to scan and identify the photo connected to a game-object "Virtual object" and then instantiating it. The following text explain a bit of the process and implementation: 


These are the assets or images that we are going to use. The system searches and recognizes these images and can then instantiate the object that is associated with it. 



Here are the game-objects that are associated with the shown images above. As you can see the game-objects are instantiated above the given image asset and when the camera or the system recognizes the image these will pop-up and start moving.

 


The movement of the animals is done via the inbuild animation renderer of the Unity system. Here can the flow of animation of the animals be seen and how they are connected. 


Author: Jannik Schwarz-Wolf




Sted: Banegårdsgade 2, 8700 Horsens, Danmark

Kommentarer

Send en kommentar

Populære opslag fra denne blog

XR project final part and XR Expo

Billede
This last post on this blog will concern the final version of the XR barcade project, as well as some notes on the XR Expo, where we have demoed this project.   Sadly, not all features could be in the final version of the project. The biggest one, probably, is the multiplayer. This was due to the fact that, apparently, the Coherence plugin is apparently not compatible with the Oculus plugin – and, this being a VR experience, the Oculus plugin had to take priority. Obviously, this also had the consequence of the Movement SDK parts being deemed unnecessary, and removed. We all regretted this decision, but we had no other option. Regardless, we feel we have gained valuable experience from this as well – learning that a problem cannot, at least with our current tools, be solved is an important thing to any developer. In cases like this, the only thing we can do is abandon it, and focus on what we CAN solve – which we did.   In the final version of the project, three elemen...
Læs mere

Individual reflections - Kristóf Lénárd

I feel that I have gained a lot from this course. I have learned things about different types of AR, both marker-based and markerless, and have learned about VR. I have learned when to use it, how to develop apps for these, what makes these different from “regular” apps, and why is it a very quickly developing and growing field. During development, I have contributed to the marker-based AR app in the development of the code, contributed to the markerless AR app in the AR code and model creation, contributed to the VR app by developing one of the levels and in the sound design of the escape room game, and contributed to the XR app by helping the others, both in code and in general Unity development, along with adding a few bits of models, code, and sound design. Sadly, for the XR project, the main feature I attempted to develop, that is, multiplayer experiences in VR, has failed, as the package I used to develop networking was not compatible with the Oculus XR plugin. In the followi...
Læs mere

Individual reflections - Christian

My main contributions for the four projects are as follows:       - Marker-based AR project: Brainstorming, unity implementation, animation setup.       - Marker-less AR project: Brainstorming, model acquisition, portal doors & animation, interaction            script       - VR app: Brainstorming, codebreaking implementation (my own level), keypad interaction       - XR app: Brainstorming, pool level (ended up not working), general support role afterwards In the following sections I will reflect on the projects and the knowledge I have gained throughout the course.  The marker-based project was a very weird one. Of course, it being the first project we have makes it very limited in scope, but it was also plagued by technical issues from the SDK we were using. Vuforia created a lot of problems, especially for me as I was in charge of the main Unity implementation. Technical issues ...
Læs mere