Today I came up with a potential concept for my project. After taking engineering last term, I have grown interested in coding. More specifically, I wanted to combine my passion for technology and integrate it into art. Thus, for my project, I wanted to utilize AR (Augmented Reality) to create a digital gallery of my own artworks. What these artworks are in particular are subject to change but I was thinking of sculptures as I can model them online and then print them afterward. I used class time to draw inspiration and I created two mood boards, one for sculptures and another for AR sculptures.
For my homework today I wanted to do some research into augmented reality. More specifically, find out the basics. For example, which software is used to code AR protocols and how I might potentially import my 3D sculpture/model from Fusion into my virtual gallery. I also created a mini timeline so that I can make sure I am staying on track.
- Week 1: Learn Unity and create a prototype in AR to familiarize myself with the process
- Week 2: Work on image tracking code
- Week 3: Trouble shoot image tracking code
- Week 4: Finalize image tracking code
- Week 5: Finish second sculpture
- Week 6: Integrate my sculptures into Unity and 3D print my actual sculptures
- Week 7: Test my virtual gallery and make adjustments needed
- Week 8: Create a simple app to effectively showcase my gallery
- Week 9: Finishing touches
I managed to successfully set up my Unity workstation. I downloaded the AR kit and a personal license so I can get working straight away. I also spent some time playing around with the software just so I can get used to it. I downloaded some presets and plugins with the intent to simulate my prototype as quick as possible. In addition, I watched a video on how to import 3D renderings from fusion to Unity. Currently, I am planning to go through the entire process of bridging Fusion to Unity before doing any of my finalized sculpture designs.
I tried to import this lamp I designed last year on Fusion into unity but it did not work because the file was incompatible. I was extremely confused as to why that was so because I followed the exact steps of the video. It wasn’t until an hour later that I found out he was using a much older version of Unity and the video may have been outdated. I eventually figured out that the format had to be in “.OBJ” instead of the recommended fusion format. Now that I have undergone the full process of creating something on Fusion and successfully importing it into Fusion, I can work on code that is directly related to my project.
Image tracking code – Weeks 2 to 3
(This draft of my image tracking code, it still has a variety of bugs and it will not successfully upload into Unity)
Finalized image tracking code – Weeks 3 to 4
After finalizing my image tracking code, I tried to look for other ideas to import my Fusion file into Unity. This was when I found out about Vuforia. Vuforia is a plug-in you can use that has a built-in feature to recognize your uploaded images and use them as image targets. I watched a tutorial on Vuforia and created an account and claimed a license key. I plan to try and find an image target and upload it into the Vuforia portal. I will also download the Vuforia software and import it into the Unity configuration and code it so that Unity can recognize the plug-in. To conclude, the image tracking code allowed Unity to recognize the image, and Vuforia allows for the system to project the AR sculpture.
This is the target image I chose. I highlighted the features in order for the system to recognize the critical points and project my sculpture upon detection. My next task was to draw up my first sculpture and project it using my image target. I started by drawing a few concept sketches and brainstorming ideas.
Concept Sketches & Brainstorm for Sculpture #1
I ultimately went with sketch 5.
After importing my newly designed sculpture, I managed to get my augmented reality projection working. This was a good sign because it proved that both y target and code could work asynchronously. However, it lacked consistency. More specifically, the orientation of the sculpture was not upright. Another problem was that it kept on appearing and disappearing, I troubleshot the problem by changing various factors. I slid the image closer to the camera, turned the light on and off, and tilted the camera to various angles. At last, I found that it was the irregularities in light that is causing the flickering of my virtual sculpture. My next task at hand was to enter code for the system to recognize the image target regardless of the light levels.
Code for image target lighting
I worked on this code during week 4 after I finalized my image target code.
This was the code I wrote in order to solve the problem of the flickering of my sculpture. With this code implemented, I was finally able to get my sculpture to sit upright and appear with no bugs as long as the image target was in place.
As seen in the images above, the orientation has been solved. More specifically, the sculpture sits directly on top of the target as illustrated in the render. Next, I will start on my second sculpture.
After reviewing my initial design for sculpture #1, I was not satisfied with how it came out as it did not meet my expectations for what my gallery would look like. More specifically, the design did not have any sentimental meaning to me. As a result, I went back to the brainstorming process and redesigned the concept for my three sculptures. The overarching theme I decided on for my three sculptures is spirituality as it is something very prevalent in my life. I decided that my three sculpture collection will be called “Qigong”:
- Qigong comprises a diverse set of practices that coordinate body (調身), breath (調息), and mind (調心) based on Chinese philosophy. An ancient Chinese healing practice that combines meditation, controlled breathing, and gentle movement.
The first sculpture I designed represents “Breath (調息)”, one of the three aspects that combine to make Qigong. For the remaining two sculptures, I plan to design them taking inspiration from “Body (調身)” and “Mind (調心)”. I also ended up using Rhino; although it took way more time and was more complex, it had aspects of curvature that Fusion could not capture. For sculptures 2 & 3 I will continue with this theme in my collection.
Breath (調息): Link to interactive sculpture – https://app.modelo.io/share-token/1519191888731762688?source=copylink
I felt like the first iteration of my sculpture #1 was too simplistic and did not offer the sophistication of a contemporary sculpture. I added more connecting elements to the sculpture, allowing for an enhanced level of perspective. In addition, because my AR software did not allow for my sculpture to incorporate movement as seen in the video, this sculpture better encapsulates the different dimensions of the structure without any animation.
After finishing “Breath (調息)” I went back to the drawing board for sculptures 2 & 3. Because my first sculpture had a lot of circular formation, I wanted to experiment with geometrical shapes and negative space. For sculpture #2 I wanted it to represent “Body (調身)”, the second practice of the three aspects. Specifically, I wanted my sculpture to represent the lungs and what happens to it when you engage in Qigong. When undergoing Qigong, your lungs have to open up, allowing tremendous amounts of airflow to circulate the body, allowing the body to be mindful and in the moment. Therefore the holes represent the lungs opening up, allowing air to flow through the sculpture.
After consulting with Mr. Brodie about my Sculpture #2 draft, he gave me some good pointers. More specifically, he pointed out the stand and how I could potentially implement more negative space and varying sizing. I agreed with Mr. Brodie and moving forward I plan to get rid of the stand and experiment with a larger range of shapes.
After coming up with 5 different variations for sculpture #2, I went to Mr. Brodie for feedback on my different styles. He stated that he liked variation #1 the best. However, he felt that I could effectively utilize negative space to further give my sculpture some dimension. I agreed. Therefore, I went back to the drawing board and came up with a finalized proposal that incorporated elements of small spaces in the individual quadrants of the sculpture while maintaining that negative space in the center.
After showing Mr. Brodie my finalized proposal, we both thought it came out really well. However, we decided to implement a stand to make sure the sculpture could stand upright. Despite it being an AR sculpture, it would appear to be much more balanced if a stand was implemented.
Body (調身): Link to interactive sculpture – https://app.modelo.io/share-token/1527440485631467520?source=copylink
My final sculpture, “Body (調身)” with its accompanying stand. The concept for this sculpture is in lieu of my collection, this is supposed to represent the body aspect of meditation. More specifically I modeled my sculpture after the lungs and incorporated negative space and gaping holes to symbolize the importance of airflow in the lungs when undergoing meditation.
As I start designing my third and final sculpture, I took inspiration from my second sketch in my brainstorming. Because this was supposed to represent the “mind” I decided to go with a more spherical design to symbolize the brain and ideas. The design I came up with represents thinking. The different panels on the outside of the sphere are ideas and they are all being supported by a sphere in the center or the “center of your ideas”. Initially, I designed the sculpture with purple to indicate the contrast between the panels, nonetheless, I plan to change the color to match the rest of my sculptures with a grey monotone look.
Mind (調心): Link to interactive sculpture – https://app.modelo.io/share-token/1528884856327315456?source=copylink
