I know you can do this using Appium and launching the Chrome browser app. The set up is quite a bit more then selenium AndroidDriver. I have gotten pretty close to doing it. If your developing on windows, one hurdle is the framework seems to be written and maintained by all Mac users so the windows support and documentation is quite scarce. Also you will need to have root access to any device to run the chromedriver on it, (I reccommend WugFresh universal root kit for Nexus devices). The chromedriver and appium google group forums are quite good if you get stuck.
Here's a pretty good blog post using appium, java, testng, android, and windows to get you started.