More

The Way @ Runway

Nov 3, 2019

I spent most of my time this weekend working on knowSound, which I thought I might be able to finish training and bring into Runway by yesterday, while now I seriously doubt if I can finish it by the end of the semester. (2019.11.04) Runway # As a platform developed for artists and designers, Runway is well designed to be user-friendly with a beautiful interface. It’s still true nowadays that technology sounds some kind of restricted area to the majority of creatives, and the idea of “making technology accessible to artists (or everyone)”, just like the collapsible paint tube empowering painters with more and easier to obtain colors, is definitely of great demand. ...

Two Tales of One City

Oct 27, 2019

It was the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity, it was the season of Light, it was the season of Darkness, it was the spring of hope, it was the winter of despair, we had everything before us, we had nothing before us, we were all going direct to Heaven, we were all going direct the other way—in short, the period was so far like the present period, that some of its noisiest authorities insisted on its being received, for good or for evil, in the superlative degree of comparison only. ...

Hemingway Meets Fitzgerald

Oct 19, 2019

What would they write? # Hemingway and Fitzgerald are two of my favorite writers. The tiny project I did for this week, Hemingway Meets Fitzgerald, is based on an assumption that could never happen: What if Ernest Hemingway (1899-1961) and F. Scott Fitzgerald (1896-1940) could write together? How could their writing style affect each other and tell a story that has never been told before? What’s more, Fitzgerald is known for his descriptive language while Hemingway habitually used the word “and” in place of commas to convey immediacy and simplicity, with a writing style shaped “in reaction to [his] experience of world war. ...

Dancing Glow

Oct 7, 2019

Your browser does not support the video tag. -- Please contact the blogger for the video demo of the project. This week I tried real-time data collection and multiple, different types of inputs and output with the new Neural Network feature of ml5.js. Dancing Glow, as a result, is a visual project in which lines following the body will change to different colors according to body positions as trained. ...

knowSound( )

Oct 7, 2019

IN PROGRESS I’m planning to train a sound classification model for ml5 among a group of CV models. I’ve found a relatively small (around 1000-2000 pieces of sound effects files) yet well labeled dataset of sound effects: Adobe Audition Sound Effects. The dataset, or the sound effects library, is high quality while open-sourced and royalty-free. All the files were well named thus perfectly labeled for the training, here’re several examples: ...

Housing Price

Sep 25, 2019

This page is a composite of Assignment 4a and 4b. The Dataset # After a long time wandering in Kaggle and OpenML, I finally decided to choose the dataset of Housing price in Beijing (Housing price of Beijing from 2011 to 2017, fetching from Lianjia.com.) from Kaggle as the data I’m to collect, wrangle and build on for this week’s assignment. My interests and curiosity of housing price might be arisen by Ekene Ijeoma’s Wage Islands: Immigrants project - a sculpture to visualize where low-wage immigrant workers can afford to rent in NYC. ...

Violinist

Sep 22, 2019

UPDATE: The name of the project has been changed to Guitarist! Group Project with Heather Kim Violinist enables user to play violin (or potentially any type of instrument) by just posing as they are playing it. This simple have-a-try project is based on p5.js, ml5.js, and poseNet, and help us understand the basic use of poseNet and p5.serialControl. Here’s the LINK to p5 web app (p5.serialControl and Arduino required). ...

aPPle!

Sep 15, 2019

🍎🥮🐟🍊🍳🍞🍗🍔🍟🥔🍚🥘💣 aPPle! is a webcam game powered by p5.js and ml5.js. In the game, various kinds of food will fly into the screen and the player need to choose only healthy food, that helps to lose weight, to eat. The player also need to dodge bombs flying into the screen from time to time. Office chair with wheels is recommended to use for playing. Here’s the LINK to play on p5 web editor. ...

A Glance of AI

Sep 9, 2019

How to say Hi in Klingonese? # In this section a task and corresponding AI system will be designed. Klingonese is an artificial alien language, every word of which is well documented and can be easily looked up by Star Trek fans. But when we’re faced with real Aliens, in like 100 years, we’ll have to listen to languages we’ve never heard of before. We’ll know nothing about the vocabulary, grammar, or structure, and we’ll have no family or root languages to compare to. ...

ImageNet

Sep 9, 2019

The first thing that amazed me was that the project of ImageNet took full advantage of WordNet and benefited from Mechanical Turk. In this way, the data is so organized by synonym sets and, sounds crazy, human-annotated. The data can be looked up easily through treemap visualization. While each syntex, as claimed, has more than 1000 images on average to be illustrated, I still found some weak portions. With only 138 picture for People section, a lot of subdivisions, including business people and lobby boy, have no photos. ...