JOURNAL 1: KINECT VS KINECT 2.0

Terra(1161100234)

What is kinect&kinect 2.0?

Kinect is:

 - produced by: 
      Microsoft for Xbox 360 and Xbox One video game consoles and Microsoft Windows PCs
 - a motion sensing input devices
 - enables users to control and interact with their consoles/computer without any intermediary devices
 - such as: controllers
 - through a Natural User Interface (NUI), using gestures, spoken commands, body movement
 - uses an RGB camera with depth sensor and infrared projector with a monochrome CMOS sensor
 - which sees the environment not as a flat image, but as dots arranged in a 3D environment.

Difference between kinect and kinect 2.0?

• Kinect v1 is more lightweight and easy to carry and to install.
• there are more problems if use multiple Kinect v1, since they interfere a lot with each other.
• Kinect v1 interfere because they calculate depth using a IR light pattern projection, while Kinect v2 do not because they use another way to compute depth: time-of-flight.
• With Kinect v1 you can connect up to 4 to the same PC, you can use more Kinect v2 together but you can't connect them to the same PC.
• Kincet v2 seems a more refined version of Kinect v1- it is bigger and has a lots of cables and power converters.
• increase in resolution has been impressive, with the v2 reaching the full-HD resolution.
• Kinect v2 tracks more people, with more joints, faster and with greater precision.
• By using webcam&camera, Kinect v2 has much better field of view, color and resolution than the old one, new kinect has much sharper edges, less fuzzy and more precise and detail.
• In old kinect sensor, there is a lot of noise and it's not as precise as Kinect v2.

• Feature	Kinect	Kinect 2
  Method to calculate depth of objects in scene	Structured light	Time of flight
  Developed by	Microsoft + Prime Scene	Microsoft
  Resolution	480 P	1080 P
  No. of skeletons tracked	2	6
  Bone orientation	No	Yes
  Forces at body joint	No	Yes
  Muscle simulations	No	Yes
  Recognizing expressions	No (can write own algorithm)	Yes
  Face tracking	Yes	Yes
  Measuring heart rate	No	Yes
  SDKs available	Kinect for windows SDK v1.8 OpenNI v2.2	Kinect for windows SDK v2.0
  USB Standard	2.0	3.0
  Supported OS	Win7,8	Win 8

Software:

Microsoft Kinect SDK 1.8
Microsoft Kinect for window SDK 2.0
Webcam Zone Trigger Pro 3.x

How to interact with kinect &kinect 2.0?

One of the example of using kinect:

Use kinect with the Xbox 360 dashboard. 

• You can use kinect to control the Xbox 360 using both your voice and gestures. 
• Make sure to have the latest console software.

Use gestures with the Xbox Dashboard

• hold your arm straight out to the side and bend your albow upward
• wave to kinect with your hand by moving your forearm left and right 
• once you wave at the Xbox Dashboard, a hand cursor appears
• You can now use gestures to navigate the dashboard instead of a controller

Use voice commands with the Xbox dashboard

• when you're at the Xbox dashboard, say 'Xbox'.
• the kinect speech bar opens
• you can now say any of the words that appear on the screen
• for ex: say " Xbox Social" to move the Social area of the daashboard

1) Kinetic projector: touch screen

• based on the video as example:
• the video demonstrates of how the program detect the projected screen, hand position and distance
• all you need is a projector and a kinect to have your own interactive wall
• 
  

• the kinect sees how it is being projected, and then the software will interpret what is the shape of the surface, were they displace and how big is the displace
• once it knows that, it also detects where your fingers are...
• https://www.youtube.com/watch?v=ISKV1BeB3pM

Kinect's ability are also being used extensively in performing arts and contemporary dance.

2) Interactive Dance Performance with Kinect

• based on the video as example:
• a performance that associates a dancer's body with visuals to produce a digitized physical choreography
• plays on perspective and depth perception to showcase the movement of the dancer's body
• interactive digital content and software dance show was developed by We Dream
• motion tracking algorithm, creates visuals based on projective coordinates of each dancer on XYZ plane.
• The software development finished in 10 days and debugged in 2 days
• Setup uses a Kinect™ Sensor, 8000 Lumen projector. 
• it was organized by Bilgi University Students
• https://www.youtube.com/watch?v=daQZ5J5YbQg

References:

https://en.wikipedia.org/wiki/Kinect

https://www.youtube.com/watch?v=Zx2E19IV2zs&t=107s

https://skarredghost.com/2016/12/02/the-difference-between-kinect-v2-and-v1/

https://support.xbox.com/en-US/xbox-360/accessories/how-to-use-the-kinect-hub-and-guide

ASSIGNMENT 1: MOST INTERESTING ARTWORK

Terra(1161100234)

The most interesting artwork I choose:

Final artwork in MA 1

Before my final output, I had gone through several process of creating the artwork.

1. Social experiment:

•       Gift giving social experiment
•       LINK: https://www.youtube.com/watch?v=8CDvi-eVFik&t=92s

Conclusion- “A lot of people would willing to share out their gift, but shockingly is people won’t trust to accept the gift.” 

-This social experiment is about gift giving experiment. 
-The passerby can either choose to keep the gift themselves or they give the gift to strangers. 

2. Survey

Based on the survey final outcome:

•       1. Gender: Female

•       2. Age: 19 years old

•       3. Occupation: Student

•       4. Hobby: Reading

•       5. Character: Scared, Protective, Don’t trust people, suspicious..

•       6. Favourite colour: Blue& Grey

•       7. Favourite tidbit: Chocolate

•       8. Favourite animal: Puppy

•       9. Desire: Sweetness and romance

•      10. Texture: Rough

Through the final outcome, we have to create a persona and give this person an identity, personalities and others.

Sketches:

 

Artist statement:

 (Express: although there is no trust in the society, but people still hope for trust, and they are willing to accept the gift if they believe trustworthy is there.)

   My survey was applied into my artwork, 

     It tells the story of this girl, Emma Brown, 19 years old student, who desired the right love very much as she once had been betrayed and hurt by her lovers or love ones (trustworthy of society decrease). The hourglass brings out the concept of safe zone and to represents time. As times pass, Emma kept herself protective in her own safe zone and never to trust any man (many people reject the gift as to protect their own safety first and never to trust any strangers). She was always suspicious of men who try to be good to her and scared of trying to love. (people trying to approach with good deed but got rejected, people scare to receive the gift from strangers)

    The rose represents Emma, who is beautiful but with unapproachable thorns. (also represent the unknown present) The sand represents desire/desperation and the water represents the right love. (the hope for trustworthy in the society) While sand is not suitable for most of the plant, hence plants will desire for water if not it will wilt and die. The concept applied is Emma still desire for the right love/right man in her life although she had been hurt and betrayed. She longed for the right lover. The texture applied is rough cloth, means her life were betrayed and hurt, and she tries to mend it. The background was in black to show that Emma is a lonely, hurt, unapproachable girl.

Challenge:

- time consuming

- materials

- budget

- non-interactive

Target Audience:

- People who had the experience been hurt and betrayed before either in social or love life
- University students (18-25)

3 Technical Ideas Implied:

1. Projection Mapping Painting

Took a picture of the painting, then in an After Effect composition, add special effects to it/create animation for the painting, create second composition to be projected on the wall. By using live preview, adjust the position of the first composition to match the real canvas.

Artwork projection mapping:
https://www.youtube.com/watch?v=QOLuJvafgQo
Homemade projection mapping:
https://www.youtube.com/watch?v=fFoC8iNgIgw

Artist Impression:

My idea:

• Create animation/story for the painting 
• Or in an After Effect composition, add special effects to it
• Such as: colours, visual etc.
• To express the meaning of the painting
• Measure the distance and setup the projector
• Then adjust the artwork in the computer to be projected
• Can add sound installation

Estimate Budgetary:

• Projector: RM 1000-1500
• Speaker: RM 150
• Ableton live: RM 250
• TOTAL: RM 1900

2. Game developing program unity 3D

Game developing program unity 3D, rotating mount, attached to its back is a spatial sensor to detect tilt, a driving program written by C Communication with the sensor and interacts with the unity 3D scene to respond to the users rotation of the frame.

Reference:
Interactive still life painting by Scott Garner:
https://www.youtube.com/watch?v=ipylTirN58U
https://www.designboom.com/technology/interactive-painting-by-scott-garner/

Artist Impression:

My idea:

• Transform my painting into digital form using game developing unity 3D
• Create 3D animated scene
• When the user rotate, the sand in the painting will be animated
• Write the program in CC 
• By connecting the installation of rotating mount, spatial sensor
• Which allow to respond to the users rotation of the frame

Estimate Budgetary:

• Rotating mount: RM 50
• Spatial sensor: RM 26
• Artwork frame: RM 200
• TOTAL: RM 276

3. Conductive paints

A collaborative painting using, conductive paint. The conductive paint act as a capacitive sensor, allowing for hover movement and touch to be detected. This creates the interactive aspect of the painting: as one of the hovers closer and touches the painting, it will in turn and change the sound aspect of the installation. The interactive and sound aspect was created with conductive paint, arduino, max/MSP (visual programming language for music&multimedia) and ableton live.

Reference:
'Chikoyo' interactive painting
https://www.youtube.com/watch?v=zXxCkFkT4jk
Patient interactive painting
https://www.youtube.com/watch?v=RWW289PX3Yc

Artist Impression:

My idea:

• Draw my painting out by using conductive paint or pen for certain part
• Conductive paint has capacitive sensor
• It creates the interactive aspect of the painting
• As one of the audience touches the painting, it will in turn and change the sound aspect of the installation
• Different part of the paint will link to different sound
• To express/tell the story of each elements in the painting
• Such as: lack of trustworthy, being self-protective, betrayed, hurt, lonely, unapproachable, desperation and the desire for hope

Estimate Budgetary:

• Conductive paints: RM 60
• Arduino: RM 25
• Speaker: RM 150
• Ableton live: RM 250
• TOTAL: RM 485

Thankyou.