What do you get when you cross Star Wars and famous art? This algorithm can show you

Researchers have found a way to impose the style of specific artists on an entire video

Artificial intelligence has been dabbling in art to increasing acclaim over the past few months, but a new study brings its uncanny proficiency to the far-more-complicated world of video.

Specifically, researchers have now found a way to apply the style of famous artists to entire videos, meaning that you can now watch Star Wars presented with your favorite artist's touch.

Researchers in the University of Freiburg's department of computer science tapped deep neural networks to accomplish their task.

"Given an artistic image, we transfer its particular style of painting to the entire video," explains the researchers' recently published paper, which aims to build on earlier related work on still images.

One problem with video is that processing each frame independently leads to flickering and false discontinuities, the researchers found. To preserve a smoother transition between frames, they added what they call a temporal constraint that takes optical flow into account.

Another thing they added was a better way to reconstruct objects or scenery in the video hidden in one portion but re-exposed in another, making it difficult to make up for the lost time in terms of continuity.

"To solve this, we make use of long-term motion estimates," they said. "This allows us to enforce consistency of the synthesized frames before and after the occlusion."

Meanwhile, a multi-pass algorithm that processes the video in alternating directions using both forward and backward flow helps to get rid of artifacts at the image's edges.

The researchers tested their code on Ubuntu 14.04. It's now available on GitHub.

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags Star Wars

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Katherine Noyes

IDG News Service
Show Comments

Cool Tech

SanDisk MicroSDXC™ for Nintendo® Switch™

Learn more >

Breitling Superocean Heritage Chronographe 44

Learn more >

Toys for Boys

Family Friendly

Panasonic 4K UHD Blu-Ray Player and Full HD Recorder with Netflix - UBT1GL-K

Learn more >

Stocking Stuffer

Razer DeathAdder Expert Ergonomic Gaming Mouse

Learn more >

Christmas Gift Guide

Click for more ›

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Walid Mikhael

Brother QL-820NWB Professional Label Printer

It’s easy to set up, it’s compact and quiet when printing and to top if off, the print quality is excellent. This is hands down the best printer I’ve used for printing labels.

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?