Friday, May 29, 2015

Automated Stories from Google


I had recently migrated to an Android smartphone from a Windows 'not-so-smart-version' phone that I had been using for some years. This was a huge upgrade for me and more on this in a separate post, soon. I now want to talk about another feature that I had stumbled upon.

As part of my Moto G2 phone default-settings, I had enabled backup of phone camera pictures onto Google+. I was happy to get this going, since it was a chore to perform backups with my old phone, something that I had to remember to do manually with a transfer to the laptop, once in a while. Over the past couple of months I had hardly taken any pictures on the new phone and this changed with my Backpacking trip, wherein the mobile camera came in pretty handy. I was quite happy with the quality of pictures as well since, with a combination of HDR, focus & exposure settings, many a time, the pictures had turned out better than the other Sony point-and-shoot camera I carried. 

Mid-way during the trip, I got a notification that Google+ had created a picture story. With curiosity when I opened it, I was amazed to see a neat story woven by picking the best from hundreds of pictures, stitching together the location details, sequencing them across different sizes like a scrapbook and finally making it ready to share, with a suitable title. At first look, I was quite impressed with the intelligent way all of this had been put together, with no manual intervention, to create an engaging story, that almost seemed human-created!

Delving further, I understood that this feature was launched by Google in mid-2014 and it worked by simply combining the following techniques:
  1. Picking the best, refined set of pictures through algorithms, by avoiding blurred ones, repetitions and the like
  2. Using the location tag if its been set, else, use the even 'cooler' algorithm to detect the location by reading the picture landmarks
  3. Leveraging Google's auto-awesome feature to improve photos, create animations or video transitions from multiple picture frames, and set pictures with different shapes and orientations
  4. Detecting the date & time to sequence the pictures and also build the story
  5. Finally, rules to break the story into a logical number of days and picking a relevant tile (for example, my pictures over 5 days was built into 3 stories of varying duration)
It is features such as these that make me want to enable the many Google services that read my location, store my photos, sync my calendar/email and backup files - which otherwise makes me wary due to the company's growing influence & knowledge of my personal life! 

Click this picture story above, that Google created from my Bhutan trip. 

No comments: