Modernization Hub

Modernization and Improvement
2017  Innovation Day Part 7

2017 Innovation Day Part 7


WE HAVE A DIFFERENT IN SOME
WAY SIMPLER SITUATION AT NIH BECAUSE WE’RE SWIMMING IN DATA,
IT’S MORE WHAT WE DID WITH EXLOC IS MORE OF A REPURPOSING FOR
THINGS USE FORD SOMETHING ELSE TOWARD THIS PROBLEM OF PEER
REVIEW, AND AS A REVIEW OFFICER, IT’S KIND OF OBVIOUS, BUT THEN
THERE’S A CULTURAL STATUS — STASIS THAT I THINK TAKES PLACE
WHEN PEOPLE SAY I’VE GOT MY OWN WAY TO DO IT, BUT THIS WAS SO IN
LINE WITH ALL THE OTHER TRENDS WHAT WERE HAPPENING ELECTRONIC
SUBMISSION OF APPLICATIONS, THE BIBLIOGRAPHIC DATA MINING,
NATURAL LANGUAGE PROCESSING TOOLS THAT ARE CO-EVOLVING AND
WE — WHY CAN’T YOU TAKE ADVANTAGE AND DO THIS?
AND THE WAY TO GET OTHER PEOPLE INVOLVED IN IT, WE HAVE AT NIH
KIND OF A STRUCTURE, NIAID IS JUST ONE OF 27 INSTITUTES, BUT
THERE’S THESE TRANS-NIH COMMITTEES, I’M ON ONE OF THEM
AS PART OF THE OFFICE FOR EXTRAMURAL RESEARCH CALLED
SCIENTIFIC TECHNICAL COMPETENCY COMMITTEE.
ONE OF THE WORKING GROUPS I’M ON, THE I.T. WORKING GROUP,
MENTIONED — EVERYBODY WAS VERY EXCITED, IT WAS A GREAT
OPPORTUNITY FOR US TO GET BUY-IN, THIS IS HOW IT WORKS, DO
YOU HAVE ANY IDEAS, CAN YOU THINK ABOUT — DO THIS WITH
THAT, DO THAT WITH THAT. WE USE THOSE IDEAS TO BUILD AND
IMPROVE OUR PROTOTYPE. THIS ALL HAPPENS BEFORE WE
BOLDLY APPROACH JUST DEVELOPERS, CONTRACTOR, WITHOUT IT GOING
THROUGH THE EAWG, AND SAID YEAH, THAT’S HOW I WOULD DO IT TOO, SO
ONCE THAT REPORT NOW IS AVAILABLE, AT VERY LOW COST, IT
DIDN’T TAKE AN EXECUTIVE ACTION TO HAVE THIS DONE, AND IT WAS
GENERATED FROM THE INPUT OF A BROAD NUMBER OF — BROAD NUMBER
OF INSTITUTES INCLUDING THE SIGNTIVE CENTER FOR REVIEW,
WE’RE ALL USING IT NOW, SETTING UP THE WEBSITE, HANDLE FEEDBACK,
USE THAT TO MAKE IMPROVEMENTS IN PIPELINE DEVELOPMENT FOR OUR
NEXT YEAR’S PROTOTYPE, WHICH IS NOW ALREADY — IT’S NOT ON MY
DESK COMPUTER BUT IT’S INSIDE THE ERA SYSTEM AT NIH.
SO IF YOU’RE IN HHS, I’M SURE MANY OF YOU MIGHT HAVE THE SAME
SITUATION OF BREAKING THROUGH SILOS THAT WAY.
>>GREAT, GREAT. SO SOME OF THE THINGS I’M
HEARING IS LISTENING TO PEOPLE WHO ARE IN THE SPACE LIKE WITH
YOU, JESSIE. SOMETIMES IT’S TRENDS, WITH YOU,
MITRA, AND YOU, BRUCE. SOMETIMES IT’S JUST LIKE WHAT
KEEPS YOU UP AT NIGHT, WHICH IS DATA WITH WHAT YOU WERE SAYING,
MARK. SO I’M ALSO CURIOUS, WE KNOW
THAT THERE’S MANY STAKEHOLDERS IN ALL THE WORK THAT YOU GUYS
DO, AND IN ORDER FOR INNOVATION TO TAKE PLACE IN A LOT OF WAYS,
YOU HAVE TO BRING IN LEADERSHIP, AND YOU HAVE TO BRING IN A LOT
OF PEOPLE WITHIN YOUR AGENCIES OR ORGANIZATIONS ALONG WITH YOU.
SO WE JUST TALKED ABOUT OUR USERS, BUT I’D LOVE TO HEAR
ABOUT SOME OF THE THINGS THAT YOU DID AND ALSO MAYBE SOME
CHALLENGES YOU CAME UP AGAINST AND HOW DID YOU WORK THROUGH
THEM AS YOU WERE MOVING FORWARD?>>WELL, I’LL HAVE TO GIVE A LOT
OF CREDIT FOR THE NON-ACCELERATED PROGRAM TO THIS,
BECAUSE I’M A LITTLE BIT BASHFUL ABOUT GOING UP TO THE DEPUTY
DIRECTORS AT NIH, KNOCK ON THE DOOR AND SAY CAN I TALK TO YOU
ABOUT MY IDEA — THAT OPENED THOSE DOORS AND TALK WITH OUR
DEPUTY DIRECTOR FOR EXTRAMURAL RESEARCH, THE DEPUTY DIRECTORS
AT NIAID AND EXTRAMURAL ACTIVITY AT NIAID, AND OTHER PEOPLE
OUTSIDE OF NIH ABOUT THIS IDEA, AND INCLUDING THE DIRECTOR OF
THE CENTERS FOR SCIENTIFIC REVIEW.
WE DID THAT AS A TEAM APPROACH, BUT WE REALLY WERE ABLE TO HEAR
WHAT IT IS THAT THEY’RE WORKING ON AND WE CAME TO REALIZE THAT
THERE’S PRIVATE COMPANIES THAT ARE TRYING TO DO THE SAME THING.
YOU KNOW, BUT WE HAVE AN ADVANTAGE BECAUSE WE’RE INSIDE
AND THEY’RE OUTSIDE OF NIH, SO WE HAVE ACCESS TO A LOT OF DATA
THAT’S CONFIDENTIAL BUT THAT WE USE, SO IT GIVES US A
COMPETITIVE ADVANTAGE, BUT AT THE SAME TIME, THIS IS JUST OUR
DAY JOB. WE CAN’T DO IT LIKE — WE REALLY
CAN’T COMPETE WITH THEM FULL TIME LIKE PREVIOUS TALKER WAS
TALKING ABOUT LIKE BURN THROUGH A BILLION DOLLARS ON
DEVELOPMENT. SO WE’RE ABLE TO DO THIS FOR LOW
COST SOLUTIONS BUT WE REALLY HAD A LOT OF SUPPORT FROM THE PEOPLE
WE WERE ABLE TO TALK TO AFTER OUR EXPERIENCE HERE THROUGH
IGNITE.>>ONE THING I WANTED TO KNOW,
BRUCE, IS THIS SOMETHING THAT WAS THEIR FULL TIME JOB OR WAS
IT SOMETHING THAT’S ABOVE AND BEYOND WHAT YOU DO EVERY DAY?
>>OH, NO, NO, THIS WAS SOMETHING — WE DEVELOPED TO
HELP US WITH OUR FULL TIME JOB. THEN WITH IGNITE, WE HAD MORE
TIME TO WORK ON IT. I JUST HAD ONE OF THOSE WEEKS.
>>YES, THAT’S COMMONPLACE IN THE GOVERNMENT.
>>SO THE PROJECT — IT WAS LIKE HAVING A DAY JOB AND DOING THIS
ON THE WEEKEND AT NIGHTTIME ON OUR OWN, AND BECAUSE WE’RE
PASSIONATE ABOUT IT, HOW WE DID IT, WE WERE — UNFORTUNATELY I’M
RISK AVERSE TO THE ENVIRONMENT. SO I AM FORTUNATE NOW BECAUSE
I’M IN THE — MOVED TO THE FDA FOUR MONTHS AGO AND THE CULTURE
IS VERY DIFFERENT THERE, ASK THE STAFF TO DO INNOVATIVE WORK, BUT
WHEN I WAS TRYING TO DO THE — PROJECT, HHS IDEA LAB, I THINK
WAS WONDERFUL BECAUSE THEY OPENED THE DOOR FOR US, THEY
GAVE US THAT PROTECTED TIME WHEN WE HAD THE BOOT CAMP, THEY GAVE
US PROTECTED TIME TO FIGURE OUT THE PROBLEM AND WHAT THE BEST
SOLUTION IS, SO I HIGHLY COMMEND THEIR PROGRAM BECAUSE IT WAS
VERY USEFUL, BUT IT IS DIFFICULT AND EVEN THOUGH WHEN WE FINISH
OUR PROJECT AND WE SAID, WOW, WE SAID THIS IS A GREAT PROJECT, WE
CAN SAY — I WAS JUST WAITING FOR THAT PHONE CALL, IT’S LIKE,
IS SOMEONE GOING TO CALL AND SAY, HEY, WE’LL PICK OUT THIS
PROJECT AND MOVE IT FORWARD, AND THE PHONE CALL CAME IN AUGUST
THAT — AND WE WERE FORTUNATE BECAUSE HHS IDEA LAB PUT IT ON
YOUTUBE, THE PROJECT, AND THEY SAW THE YOUTUBE PRESENTATION,
AND THAT’S HOW THEY CONNECTED TO US.
THEY MADE THE MAP WHICH IS NOW IMPLEMENTED IN 19 STATES.
>>JUST ECHOING WHAT EVERYONE ELSE SAID, I THINK FOR US, A
CHALLENGE WAS NOT NECESSARILY HAVING THE INTERNAL EXPERTISE OR
INFRASTRUCTURE TO KIND OF EMBRACE A PRIZE COMPETITION OR A
CHALLENGE, IT’S REALLY DIFFERENT THAN AWARDING A GRANT OR
CONTRACT, SO IT WAS A LITTLE BIT HARD TO EMBRACE SOMETHING NEW
FROM TIME TO TIME. I THINK WE DID HAVE A LOT OF
SUPPORT FROM THE IDEA LAB, WE WERE PUT IN TOUCH WITH OTHER
AGENCIES THAT HAD DONE THE COMPETITION SO IT WAS REALLY —
HAD SOME OF THE SAME QUESTIONS ABOUT THE COMPETE FACT AND WHAT
THEY ALLOW, BUT WE DID ALWAYS HAVE GREAT LEADERSHIP SUPPORT,
WE JUST HAD TO SORT OF FIGURE OUT THE MECHANISM.
NOW THAT WE’VE DONE IT, WE FEEL MUCH MORE COMFORTABLE.
IT WAS SORT OF LEARNING A COMPLETELY NEW WAY OF DOING
THINGS. THAT WAS OUR BIGGEST CHALLENGE.
>>AND ON TOP OF THAT, ONE OF THE THINGS I’LL SALE IS THAT I
THINK YOU MENTIONED OSTP EARLIER AND THE AICA ACT, THE AMERICAN
INNOVATION AND COMPETITIVENESS ACT.
THAT’S A MOUTHFUL, BUT IT’S A GREAT ACT, THEY ACTUALLY
RE-AUTHORIZED IT IN JANUARY OF THIS PAST YEAR, AND THEY REALLY
LISTENED TO THE PEOPLE WHO WERE HAVING STRUGGLES, WHO THEY WERE
GOING TO, WE CALL THE GATE KEEPERS, THE LEGAL AND SECURITY
FOLKS, AND WE STARTED ASKING WHAT ARE THE THINGS THAT FROM A
LEGAL PERSPECTIVE OR LEGISLATIVE PERSPECTIVE CAN WE BRING IN, AND
REALLY IT GIVES YOU SO MUCH LEVERAGE TO BE ABLE TO DO PRIZES
AND CHALLENGES AND GRAND CHALLENGES TOO, AND THEY’LL BE
ANNOUNCING SOME NEW GRANT CHALLENGES COMING FROM THE WHITE
HOUSE. SO MAKE SURE YOU LOOK AT THAT
ACT, AICA, AND IF YOU HAVE SOME PROBLEMS THAT YOU’RE TALKING TO
PEOPLE, THAT’S SOMETHING TO DEFINITELY POINT OUT AND SAY WE
HAVE THIS AUTHORITY NOW.>>HOW ABOUT YOU, MARK?
>>I THINK THE CHALLENGES THAT YOU FACE, I MEAN, WE WERE IN THE
POSITION THAT WE WERE INTRODUCING TECHNOLOGY THAT WAS
NEW TO THE GOVERNMENT, BUT IT’S ACTUALLY REALLY CORE TO A LOT OF
WHAT GOES ON ON THE INTERNET, SO YOU HAVE THIS CHALLENGE OF
TRYING TO EXPLAIN THAT. WE ALSO HAD — CMS IS ACTUALLY
REALLY GOOD AT RELEASING INFORMATION, LITERALLY HUNDREDS
OF DATASETS, BUT USUALLY THEY’RE CUSTOM, SO ONE OF THE THINGS WE
WANTED TO DO WAS TO MAKE OUR API STANDARDS-BASED SO I HAVE TO
REALLY GIVE A SHOUT OUT TO A COUPLE OF ORGANIZATIONS.
THE HL75 COMMUNITY HAS BEEN GREAT.
I ACTUALLY SIT ON ONE OF THEIR WORKING GROUPS AND WE ACTUALLY
DESIGNED, HELP THEM DESIGN RESOURCES THAT WENT INTO THEIR
SPECIFICATION, SO THAT WE NOW HAVE SOMEWHERE TO PUT THE DATA
WE WANT TO PUBLISH. SO YOU HAVE THE ABILITY TO
REALLY INFLUENCE THINGS. AND THAT THEN CAN SPREAD ACROSS
THE INDUSTRY SO THAT’S A GREAT THING.
ALSO TAPPING INTO IN THE SPIRIT OF COLLABORATION, YOU CAN TALK
TO A LOT OF PEOPLE OUT THERE IN THE INDUSTRY AND GET A LOT OF
EXPERTISE THAT YOU CAN THEN USE TO BRING IN AND HELP INFLUENCE,
SO IT REALLY IS A GREAT OPPORTUNITY, AND I HAVE TO ALSO
SHOUT OUT TO THE IDEA LAB AND THE OFFICE OF CTO BECAUSE I
SOMETIMES DESCRIBE MY JOB AS BEING UNPAID BY THE U.S.
GOVERNMENT TO CAUSE TROUBLE INSIDE THE U.S. GOVERNMENT, AND
FOR THAT, YOU NEED AIR COVER, AND THAT IS ONE THING THAT THE
IDEA LAB DOES, IS IT REALLY GIVES US A CHANCE TO FOCUS AND
EXPERIMENT, AND SOMETIMES YOU MAKE MISTAKES AND OTHER
SOMETIMES YOU GET BREAK THROUGHS, BUT WITHOUT THAT YOU
EVENTUALLY REALLY DO FACE PROBLEMS.
>>I HEAR THAT, ALONG EVERY STORY, IT SOUNDS LIKE THE IDEA
LAB IS THE CENTER OF A LOT OF THINGS AND THE TRENDS I’M SEEING
ACROSS THE GOVERNMENT IS HAVING A SPACE WHERE LEADERSHIP IS
ALLOWING YOU TO EXPERIMENT AND TO COLLABORATE AND DO THE THINGS
THAT ARE COUNTERCULTURE TO A LOT OF THINGS YOU DO EVERY DAY, BUT
ALSO AT THE SAME TIME WITH EVERYTHING THAT YOU’RE DOING,
JUST EMBRACING THOSE IDEALS THAT I WAS TALKING ABOUT EARLIER
TODAY. SO THAT’S REALLY IMPORTANT.
SO I ALSO WANTED TO KNOW WHEN IT COMES TO ALL THE WORK THAT
YOU’VE BEEN DOING, WHAT ARE SOME SUCCESSES OR SOME AHA MOMENTS
YOU HAD? WE TALKED ABOUT SOME OF THE
CHALLENGES AND TRYING TO BRING PEOPLE ON BOARD, BUT AS WE ALL
KNOW, YOU KNOW, WE SOMETIMES GO THROUGH THE TROUGH OF SORROW.
YOU GUYS KNOW ABOUT THAT, IN ENTREPRENEURIAL WORLD, WE GET
INTO THIS LURCH WHERE WE FEEL LIKE IT’S — WE DON’T SEE A WAY
FORWARD BUT THEN, YOU KNOW, THERE’S SOME SUCCESSES THAT
ACTUALLY PROPEL YOU INTO THE SUCCESS THAT YOU GUYS ARE — WHY
YOU ARE HERE TODAY. SO CAN YOU TELL ME A LITTLE MORE
ABOUT SUCCESSES OR AHA MOMENTS YOU HAD IN EACH ONE OF YOUR
PROJECTS?>>OKAY.
I’VE GOT THE MIC SO I’LL START. I THINK ONE OF THE SUCCESSES
RECENTLY FOR US WAS WE ACTUALLY GOT PERMISSION TO RELEASE
DEVELOPER PREVIEW CONFERENCE IN SEPTEMBER, AND WE DID A QUIET
LAUNCH, THE HL7 CONNECTOR — A FEW WEEKS BEFORE THAT.
THAT WAS REALLY IMPORTANT BECAUSE IT GOT THE PROJECT OUT
THE DOOR, EVEN THOUGH IT’S NOT FINISH, BUT IT ALSO GAVE US A
TREMENDOUS AMOUNT OF REALLY VALUABLE FEEDBACK FROM PEOPLE
INTERESTED IN WHAT WE’RE DOING. SO ONE OF THE LESSONS I THINK
FROM THAT IS, DON’T BE AFRAID TO REACH OUT TO THOSE FOLKS OUTSIDE
OF GOVERNMENT, DON’T THINK YOU’VE GOT TO HAVE IT ABSOLUTELY
PERFECT BEFORE YOU LET IT OUT THE DOOR.
BUT ONE OF THE WORDS OF ADVICE I GOT FROM PETER LEVIN, CTO AT THE
VA WAS GET IT OUT OF THE DOOR, IT’S VERY HARD TO SHOUT THE DOOR
ONCE YOU GET THERE.>>THE SAME WITH THAT IS GET OUT
OF THE BUILDING. YOU HAVE THE DOOR, GET OUT OF
THE BUILDING.>>SO I WOULD SAY ONE OF THE
SUCCESSES AS I MENTIONED, WE WERE SORT OF ADVISED TO PULL
TOGETHER SOME EXTERNAL ADVISERS VERY INITIALLY, SO NOT ONLY DID
THEY SORT OF HELP US STRUCTURE OUR CHALLENGE, BUT THEY PROVIDED
A LOT OF MENTORSHIP TO THE TEAMS THROUGHOUT, AND I THINK THEY
WERE ABLE TO PROVIDE EXPERTISE WE DIDN’T EVEN REALIZE WE DIDN’T
HAVE, SO FOR EXAMPLE OF THE SOME OF THE TEAMS WERE SAYING SOME OF
THE FAMILYS WERE TELLING THEM THEY DIDN’T WANT TO USE THE APPS
BECAUSE THEY WERE USING TOO MUCH DATA OR THEY DIDN’T HAVE WI-FI
AND WE WERE REALLY TRYING TO MAKE THESE ACCESSIBLE TO
EVERYONE AND NOT COSTLY TO FAMILIES, SO ONE OF OUR ADVISERS
WAS WITH GOO DELL GEL AND HE WAS ABLE TO PROVIDE REALLY
INVALUABLE WORKAROUNDS, LIKE FOR EXAMPLE, ONCE A FAMILY WATCHES A
VIDEO CLIP, IT IMMEDIATELY DELETES ITSELF AND JUST REALLY
CREATIVE SOLUTIONS TO SOME OF THOSE — WE HADN’T EVEN REALIZED
WE WOULD ENCOUNTER. I THINK ANOTHER SUCCESS, I
MENTIONED WE HAD REALLY SORT OF — THAT PARTICIPATED AND THEY
CAME UP WITH REALLY DIFFERENT TYPES OF SOLUTIONS.
WE’VE BEEN TRIED CONNECTING THEM THROUGH OTHER FEDERAL PROGRAM,
SOME OF THEM HAVE GOTTEN ADDITIONAL GRANT FUNDING BUT WE
DIDN’T REALIZE THAT JUST SORT OF BY BEING ABLE TO SAY THAT THEY
PARTICIPATED IN AN HHS INITIATIVE, THEY’VE MADE SOME
REALLY AMAZING CONNECTIONS SO ONE TEAM HAS BEEN FEATURED ON
UNIVISION ANOTHER HAS ONE OF THE NEW ENGLAND PATRIOTS PLAYERS
OPENS HER HAPPEN, TALKS ABOUT THE IMPORTANCE OF FATHERHOOD, SO
I THINK JUST SORT OF THE CLOUD THAT COMES IN PARTICIPATING IN A
FEDERAL EFFORT HAS GIVEN THEM OPPORTUNITIES TO REALLY SCALE
AND REACH THEIR SOLUTIONS IN WAYS THAT WE HADN’T EVEN
IMAGINED.>>SO WE ARE FACING THIS
DIFFICULT. WE KNEW THAT WHEN WE TALKED TO
THE USERS, THEY SAID THAT, YES, THEY WOULD CHANGE THEIR
BEHAVIOR, IF THEY KNEW THERE WAS TAINTED HEROIN IN THE COMMUNITY,
THEY WERE NOT GOING TO USE IT. WE HAD THIS CHALLENGE OF NOW WE
HAVE THIS, WE WANT TO MAKE IT, HOW DO WE MAKE IT, WHERE DO WE
GET THAT DATA. SO FOR US THE AHA MOMENT WAS
DURING THE BOOT CAMP OF THE IDEA LAB, WHEN WE HAD THAT PROTECTED
TIME, IT SUDDENLY HIT US, IT’S LIKE, OKAY, WHERE DO WE GET DATA
THAT IS OPEN. NEW BALTIMORE CITY HAD 911 CALLS
THAT WAS OPEN TO EVERYONE, AND THEY ADMINISTERED NALOXONE AND
THEY WOULD GET THAT GEO LOCATION THEY WERE LOOKING FOR.
WE WERE WORKING WITH THE POISON CENTER THAT WAS GIVING US THAT
INFORMATION ALSO. SO AND THEN WE’RE THINKING OKAY,
NOW, GREAT, SO WE HAVE OUR DATA, WHAT DO WE DO AFTERWARDS, HOW DO
WE ALERT THE COMMUNITY. SO THEN IT HIT US DURING THE
IDEA LAB, OKAY, WHY DON’T WE GET JUST A COMPUTER, BECAUSE WE HAD
ZERO FUNDING, SO WE BORROWED A COMPUTER AND IT RAN THE DATA FOR
US 24 HOURS A DAY, AND WE FIGURED OUT ONE OF OUR TEAM
MEMBERS IS A BIOSTATISTICIAN SO HE FIGURED OUT THE FORMULA THAT
WHAT IS FOR THE PAST YEAR IN ANNE ARUNDEL COUNTY AND
BALTIMORE CITY, WHAT IS THE AVERAGE NUMBER OF OPIOID
OVERDOSES? WHEN WE HIT THAT ABOVE THAT
AVERAGE, WE GET THAT SPIKE AND THAT ALERT IS SENT TO US VIA
EMAIL, SO THAT WE COULD ALERT THE HEALTH DEPARTMENT.
SO THEN WE FIGURE OUT, OKAY, HOW DO WE SET UP THAT EMAIL ALERT SO
WE HAD TO SET THAT UP, AND THEN WE WENT TO THE USERS, BECAUSE
OKAY, SO NOW WE’RE GOING TO ALERT THEM, WHAT ARE WE GOING TO
ALERT THEM WITH? SO WE CAME UP WITH A ONE PAGER
OF WHAT THE ALERT SHOULD BE, AND I SENT IT TO USERS UNION.
THERE’S A USERS UNION IN NORTH CAROLINA, AND THEY BASICALLY
LAUGHED AT ME. THEY SAID, REALLY, IS THIS WHAT
YOU ARE GOING TO SEND OUT TO THE COMMUNITY?
THIS IS SUCH A DOCTOR THING TO SAY TO MAKE THIS LIST.
BUT THEY TWEAKED IT, BASED ON WHAT THEY TWEAKED, WE GAVE IT TO
BALTIMORE CITY AND ANNE ARUNDEL COUNTY AND THEY TWEAKED IT FOR
THEIR COMMUNITIES, NOT HAVING ONE SIZE FITS ALL COMMUNITIES.
SO THEY TWEAKED IT AND BASED ON THAT, WE HAD WHAT THE ALERT
MESSAGING WOULD BE AND BASICALLY WHAT HARM REDUCTION MESSAGING,
WHERE COULD THEY GET THEIR FREE NALOXONE KITS AND WE WERE TRYING
TO ENGAGE THEM TO TREATMENT. BUT ALL OF THAT AHA MOMENT CAME
FROM THE BOOT CAMP.>>YOU HAVE TO BE ABLE TO WORK
WITH A LOT OF PEOPLE, AND OUR AHA MOMENT WAS WHEN WE
DISCOVERED — IN OUR MINDS, THE ONLY WAY TO GET THIS DONE WAS A
CERTAIN PATHWAY THAT SEEMED VERY DAUNTING AND HARD TO DO UNTIL
WE — WHY DON’T WE JUST ASK THE PEOPLE THAT ALREADY KNOW HOW TO
DO THIS? BECAUSE WE’VE DONE THE WORK ON
OUR PROTOTYPE AND CAN SPEAK THE LANGUAGE, WHEN WE NEED THIS TYPE
OF WORK DONE WITH THIS DATA, THEY SAID, YES, WE CAN DO THAT,
WHEREAS IF YOU WERE TALKING TO SOMEONE IN MORE OF AN EXECUTIVE
LEVEL, HOW MUCH IS THAT GOING TO COST, WE WERE GOING TO HAVE ALL
THESE OTHER RESOURCES, BUT WE ALREADY HAVE IT, IT’S THE NIH.
IT’S TALKING TO THE RIGHT PEOPLE AND BEING AGGRESSIVE P I WAS
EX- — I EXPECT THEM TO SAY YEAH
BUT I HAVE TO GET PERMISSION FROM SOMEBODY ELSE, INSTEAD THEY
SAY YEAH, CAN I DO IT, IT’S DONE.
THAT’S SOMETIMES ALL IT TAKES. SO YOU NEED TO BE AWARE OF THAT,
AND ALSO YOU NEED TO BE PREPARED TO DO IT LIKE YOU DID,
MULTIPLE — THROUGH MULTIPLE DIFFERENT PEOPLE TO GET THAT —
YOUR OWN PROTOTYPE IN THE FORMAT THAT COULD BE MORE UNIVERSALLY
RECOGNIZED AND USED. THE OTHER AHA MOMENT WAS THE
VALIDATION, WE FOUND THAT THERE’S OTHER BIG PRIVATE
INDUSTRIES AND COMPANIES THAT ARE DOING — TRYING TO DO AND
COMPETE WITH THE SAME THING, AND THAT GAVE US A LITTLE VALIDATION
THAT THIS WAS AN IMPORTANT PROBLEM FOR US TO PURSUE.
SO THAT’S, I THINK, ANOTHER REASON WHY WE’RE GETTING SO MUCH
BROAD SUPPORT AT THE MANAGEMENT LEVEL AND NIH.
>>GREAT, GREAT. THAT ACTUALLY BRINGS ME TO THINK
ABOUT YOU WERE SAYING TALKING TO THE RIGHT PEOPLE, RIGHT?
AND –>>FIRST YOU HAVE TO FIGURE OUT
WHO THEY ARE.>>EXACTLY.
THAT’S SOMETHING THAT’S A QUESTION, AND YOU DON’T HAVE TO
GO DOWN THE LINE AND BE VERY FORMAL ABOUT IT, BUT I’D LOVE TO
HEAR FROM A COUPLE OF YOU ON HOW DO YOU KNOW YOU’RE TALKING ABOUT
THE RIGHT PEOPLE, HOW DO YOU KNOW YOU’RE TALKING TO THE WRONG
PEOPLE, THAT MIGHT BE THE QUESTION, BECAUSE YOU WANT TO BE
SURE YOU’RE BEING VERY FOCUSED ON WHAT YOU’RE DOING, BUT YOU
DON’T WANT TO TALK TO THE WRONG PEOPLE AND THAT COULD JUST
DERAIL YOUR WHOLE EFFORT.>>YOU CAN MAKE AN EDUCATED
GUESS, THEY MUST KNOW HOW THIS WORKS, YOU KNOW, THEY MUST
UNDERSTAND WHAT WE’RE TALKING ABOUT, BUT THEY CAN BE THE WRONG
PEOPLE TOO, SO YOU JUST HAVE TO BE BOLD AND KNOCK ON SOME DOORS
AND IT WORKED. I MEAN, IT WORKED FOR US.
>>FOR US, AT THE BEGINNING OF THE IDEA, AND WE WERE
BRAINSTORMING, IT’S LIKE WHO IS OUR END USERS, SO OUR TEAM WAS
KIND OF DIVIDED WHEN WE WERE DOING THIS.
THE TEAM WAS SAYING OKAY, WE REALLY NEED TO GO TO THE SENIOR
LEADERSHIP, GET THEIR INPUT OF HOW THIS PROJECT WOULD GO
FORWARD, AND I WAS KIND OF PUSHING THE OTHER SIDE, IT WAS
LIKE, NO, THE USERS — THE END USERS ARE THE INDIVIDUALS WHO
ARE USING THE SUBSTANCES IN THE COMMUNITY, SO I SAID WE NEED TO
DEFLECT — SO WE DID BOUGHT ROUTES TO SEE WHICH ONE WOULD
WORK AND REALLY WE ENDED UP WITH THE INDIVIDUALS WHO WERE USING
DRUGS.>>WE ENDED UP GOING DOWN THE
LINE AGAIN. FOR US RIGHT PEOPLE WE REALIZED
MEANT SORT OF DIVERSITY OF PERSPECTIVES SO WHEN WE DID SORT
OF THE MENTOR SHIP PIECE FOR OUR TEAM BECAUSE THEY WERE
ENCOUNTERING DIFFERENT KINDS OF CHALLENGES, WE NEEDED EXPERTS IN
LOCAL PROGRAM — ADVISER FROM GOOGLE SO IT WAS SORT OF
BRINGING PEOPLE TOGETHER WITH DIFFERENT PERSPECTIVES TO KIND
OF HELP APPLY TECHNOLOGY TO THIS EARLY CHILDHOOD ISSUE.
>>SO SOME OF THE THINGS I’M HEARING IS EXPERTS, TRYING TO
TALK TO ANYBODY AND EVERYBODY, WHO WILL LEAN INTO IT, AND
SOMETIMES IT’S TRIAL AND ERROR. SO MANY DIFFERENT PATHWAYS.
MARK, DO YOU HAVE ANY THOUGHTS?>>YES.
CERTAINLY WITH WHAT WE’RE DEALING WITH FOR US WITH
BUILDING AN API, WE’VE GOT TO BE VERY CAREFUL ABOUT THE RELEASE
OF DATA. SO YOU NEED TO MAKE SURE YOU’RE
BRINGING ALONG THE IT AND INFORMATION SECURITY FOLKS
INSIDE, BUT YOU ALSO NEED TO BE TALKING TO PEOPLE OUTSIDE
BECAUSE THEY’RE ULTIMATELY THE USERS OF WHATEVER YOU’RE
BUILDING, SO YOU HAVE TO REALLY GET THAT CONSENSUS, AND SOME OF
THE THINGS WE SPECIFICALLY FOUND CHALLENGES WITH IS FOR EXAMPLE
21ST CENTURY CURES WAS SIGNED INTO LEGISLATION AT THE END OF
LAST YEAR, AND IT ACTUALLY HAS A THREAT OF FINES FOR INFORMATION
BLOCKING, WHICH IS REALLY IMPORTANT.
BUT WHAT DOES THAT MEAN? FOR US, WE HAVE TO TAKE SOME
CARE ABOUT WHAT APPLICATIONS ARE GOING TO CONNECT TO OUR API.
BUT IF WE HAVE TOO MANY CHECKS AND BALANCES, ARE WE THEN
INFORMATION BLOCKING? SO WE’VE ACTUALLY DONE A LOT OF
WORK IN TRYING TO GET SOME CONSENSUS, TALKING TO FOLKS
AROUND THE INDUSTRY ABOUT WHAT’S THE RIGHT THING TO DO, WHAT’S
THE RIGHT BALANCE, BECAUSE WE WANT TO GIVE BENEFICIARIES
CONFIDENCE IN THE APPLICATIONS THAT THEY’RE CONNECTING, BUT CMS
DOESN’T WANT TO BE PICKING WINNERS AND LOSERS OR APPEARING
TO ENDORSE PARTICULAR APPLICATIONS.
SO THERE’S A REALLY INTERESTING BALANCING ACT WE HAVE TO DO.
>>GREAT PERSPECTIVE. I THINK THAT’S BEEN SOMETHING
UNIQUE TO GOVERNMENT TOO IN A LOT OF WAYS.
IF YOU’RE IN PRIVATE SECTOR –>>YOU CAN PICK WHOEVER YOU
LIKE.>>EXACTLY.
IN GOVERNMENT, YOU HAVE TO BE CAREFUL ABOUT WHO YOU’RE GOING
IN TO BED WITH, SO TO SPEAK.>>EXACTLY.
AND THAT’S — OUR DEVELOPER PREVIEW IS OPEN TO ABSOLUTELY
ANYBODY. YOU CAN’T GET AT ANY PRODUCTION
DATA, RIGHT, BUT YOU CAN PLAY WITH OUR API.
AND WE ARE NOT DISCRIMINATING ABOUT WHO CAN CONNECT TO THAT
AND TRY BUILDING APPLICATIONS.>>CREATING AN INCLUSIVE
ENVIRONMENT TOO, ALLOWING PEOPLE — ANYBODY WHO CAN
PARTICIPATE IN THAT, I THINK CIVIC TECH IS A HUGE GROUP OF
PEOPLE, YOU HEAR CODE FOR AMERICA, THERE’S INDIVIDUALS IN
THE COUNTRY WHO ARE LIKE I JUST WANT TO WORK WITH DATA AND MOVE
THAT FORWARD. SO IT’S GREAT, GREAT WORK.
SO WE HAVE ABOUT 10 MINUTES LEFT, BUT I WANTED TO DO A FAST
PACE THING BEFORE WE OPEN UP TO QUESTION FROM THE GROUP.
SO I’M CURIOUS TO KNOW, YOU KNOW, YOU TALK ABOUT THE IDEA
LAB, YOU TALKED ABOUT THE RESOURCES, HAVING THE SPACE THAT
YOU CAN EMBRACE THIS CHANGE AND EXPERIMENT, BUT I’D LIKE TO
KNOW, WAS THERE ANY RESOURCE ORENING PARTICULAR THAT REALLY
MADE — WAS LIKE THAT SILVER BULLET THAT REALLY MADE YOUR
PROJECT WORK FOR YOU?>>FOR US, THE IDEA LAB, WE WERE
ACTUALLY STILL USING RESOURCES TODAY.
THE IDEA LAB ACTUALLY HAS AN ACCOUNT ON AMAZON WEB SERVICES,
RIGHT, SO WE WERE ABLE TO SET UP MACHINES AND EXPERIMENT VERY
QUICKLY SO A YEAR AND A HALF AGO, WE RAN A CODE-A-THON WITH A
BUNCH OF FOLKS THAT CAME AND SAT IN THIS ROOM AND ANOTHER ROOM
FOR A COUPLE DAYS AND ACTUALLY BUILT APPLICATIONS WHICH WE
DEMONSTRATED, SO THAT RESOURCE, WITHOUT HAVING TO GO THROUGH
LOTS AND LOTS OF FORMS TO SIGN WAS ABSOLUTELY INVALUABLE AND
STILL USEFUL TODAY.>>I HAVE THE SAME RESPONSE.
THE IDEA LAB, THEY REALLY HELPED US IN TERMS OF ADVOCATING FOR US
AND MAKING SURE THAT WE REALLY MADE THIS HAPPEN.
THEY PROVIDED US WITH CONNECTIONS AND SUPPORT AND THEN
JUST REALLY HIGH LEVEL GUIDANCE IN STRUCTURING OUR CHALLENGE,
EVEN TO HOSTING OUR DEMO DAY HERE, AND ESPECIALLY OUR
COLLEAGUE, SANDY PATEL AT THE IDEA LAB, BECAUSE IT’S BEEN A
THREE-YEAR PROJECT, SO WE JUST REALLY CAN’T THANK THEM ENOUGH,
THAT’S REALLY WHAT HELPED US GET FROM START TO FINISH.
>>THEY’RE NOT GETTING AWARDS OR MONEY FROM THE IDEA LAB FOR
SAYING THESE GREAT THINGS.>>EXACTLY THIS, IS TOTALLY ON
OUR OWN, AND I HAVE TO SAY IT’S THE IDEA LAB TOO, AND THE REASON
BEING — YOU’RE HEARING THE SAME THING AND THE REASON BEING
BECAUSE THEY GAVE US A MENTOR, AND THE MENTOR REALLY, I THINK
WHAT WAS USEFUL TO US, HE PUSHED US.
IT WASN’T THAT HE WAS AN EXPERT IN THE OPIOID FIELD, BUT HE KIND
OF PUSHED US BECAUSE EVERY TIME DURING THIS FEW MONTHS WERE YOU
LIKE OKAY, THIS IS NOT GOING TO WORK, IS THIS REALLY GOING TO
WORK, IT’S NOT GOING TO BE PERFECT, AND IT DIDN’T COME OUT
PERFECT AND I THINK THAT WAS THE BEAUTY OF IT.
IF EVERYTHING WENT BEAUTIFULLY, THERE WERE NO LESSONS LEARNED.
BUT HE KEPT PUSHING US, IT’S NOT GOING TO BE PERFECT, WHY DOES IT
MATTER, WHY DON’T YOU TRY IT, SEE WHAT HAPPENS.
AND I THINK THAT WAS GREAT, I WAS — THAT WAS THE SUPPORT WE
NEEDED AND THE PUSH FOR US TO MOVE FORWARD.
>>WELL, THE IDEA LAB, IT HELPED US GET THE EXPOSURE, PROFILE AND
PROMOTION WE NEEDED TO GET THE BUY-IN FROM THE END USERS THAT
WERE ALWAYS THERE, AND SO IT WAS LIKE USING THE FIRE ANALOGY, A
LOT OF DRY WOOD THERE, WE HAD SUPPORT AT OUR OWN INSTITUTE AND
THEN AT THE NIH LEVEL, AND WE SAY IGNITE ACCELERATOR, WE WERE
RIGHT THERE, AND THEY FOLLOWED THROUGH WITH REAL SIGNIFICANT
PROMOTION. SO WE ARE NOW SO WELL PLUGGED IN
TO THE WHOLE EXTRAMURAL STRUCTURE THERE AT NIH, THAT
THIS IS REALLY EXCITING HOW IT’S CATCHING ON, AND HOW IT WAS SAID
EARLIER, YOU HAVE TO BE PREPARED, WHAT IF THIS THING
SUCCEEDS, WE REALLY WEREN’T THINKING IN TERMS OF THAT.
BUT NOW WE’RE HAVING TO WORK EVEN HARDER TO GET THIS SET UP
TO WORK ALL THE END USERS.>>I JUST WANTED TO ADD ONE MORE
THING. WHAT WAS IMPORTANT TO THE
LESSONS LEARNED, IT WASN’T JUST FOR THIS PROJECT.
WHAT THEY DID, THEY PUT THAT FOUNDATION FOR US THAT NO MATTER
WHERE YOU ARE, YOU CAN CREATE, YOU CAN INNOVATE, AND I REALLY
TOOK THAT BACK TO MY WORK AND DID IT INTO DAILY THINGS, THE
DAILY WORK, THEN I TOLD EVERYONE ELSE ABOUT IT, IT’S LIKE, LET’S
DO THIS. AND I MENTORED OTHER PEOPLE WHO
SUBMITTED IDEAS TO NIH. SO THIS WAS JUST MORE THAN JUST
A PROJECT, IT WAS CHANGING THE WHOLE BELIEF THAT WE CAN ALL
MAKE A CHANGE AND DON’T EXPECT PERFECTION, THAT’S OKAY, BUT AS
WE STRIVE TO MAKE A CHANGE.>>I THINK IT’S ABOUT BUILDING A
COMMUNITY, I THINK THAT’S AT THE HEART OF WHAT YOU DO.
TO BRING IT BACK FULL CIRCLE BEFORE WE OPEN UP FOR QUESTION,
I WORK FOR A GSA WHERE INNOVATION.GOV IS BASED OUT OF,
AND AT THE SAME TIME WE’RE DOING OUR BIG LAUNCH IN FEBRUARY OR
MARCH OF NEXT YEAR, WE’RE ALSO GOING TO BE LAUNCHING OUR OWN
INCUBATOR, THAT WILL BE — ANYBODY WITHIN GOVERNMENT CAN
PARTICIPATE IN, AND WE’RE GOING TO TAKE CROSS AGENCY PRIORITY
GOALS AND TRY TO TACKLE THOSE IN AN INNOVATIVE WAY.
IF ANYBODY HERE IS INTERESTED IN SEEING OUR ALPHA OF
INNOVATION.GOV WHEN IT LAUNCHES IN JANUARY, AND GIVING US
FEEDBACK, I’M HAPPY TO TALK TO YOU AFTERWARDS, YOU CAN GIVE ME
YOUR EMAIL, AND ALSO WE’RE ABOUT BUILDING COMMUNITY, SO IF YOU
WANT TO BE PART OF THIS MOVEMENT, WE’RE EXCITED TO HAVE
YOU AND LIKE I SAID, WE HAVE MORE THAN A THOUSAND INNOVATORS
IN THIS ALREADY, BUT 120 ACTIVE USERS WHO ARE BUILDING SOMETHING
FOR US. SO IT’S BEEN QUITE A WILD RIDE
IN NINE MONTH HERE, SO LET’S OPEN IT UP FOR QUESTIONS.
DOES ANYBODY HAVE ANY QUESTIONS OUT THERE?
>>DO YOU EVER USE CROWD SOURCING PLATFORMS JUST
INTERNALLY IN YOUR GOVERNMENT AGENCIES TO GET IDEAS FROM YOUR
COLLEAGUES IN>>SO I AM NOT AT THE FDA, I
JUST CAME AT THE FDA FOUR MONTHS AGO SO I’M LEARNING, BUT AT THE
FDA, THEY ARE EXTREMELY INNOVATIVE.
I AM REALLY IMPRESSED, THEY HAVE CROWD SOURCING INTERNALLY, THAT
TO GET IDEAS, AND THEY EVEN HAVE AN INNOVATION LAB, SO THAT THE
STAFF CAN PUT UP THEIR IDEAS AND SEE, COLLABORATE, FIND IDEAS
THAT THEY CAN COLLABORATE ON. SO FDA IS EXTREMELY UNIQUE, I
WOULD SAY.>>I CAN TALK ABOUT THIS.
SO I WAS — IT DEPENDS ON WHERE YOU ARE.
THERE’S DIFFERENT LEVELS OF SCALES OF INNOVATION.
I KNOW TSA WAS ONE OF THE FIRST ORGANIZATIONS OUT OF THE FEDERAL
GOVERNMENT. BACK, I THINK, IN 2000 OR 2007
MAYBE, I’M GETTING THE NUMBER WRONG, BUT THEY WERE ONE OF THE
FIRST PEOPLE TO USE CROWD SOURCING AND THEY WANTED TO KNOW
HOW DO PEOPLE GO THROUGH — HOW CAN WE HELP PEOPLE GO THROUGH
SECURITY FASTER? SO THEY ASKED THEIR TSA AGENTS,
SO THEY WERE GETTING IDEAS FROM THAT.
SO MANY DIFFERENT AGENCIES, SO I WAS JUST TALKING ON A PANEL AT
THE CIA LAST THURSDAY, AND THEY ARE IN A CLASSIFIED SPACE SO YOU
DON’T HEAR ABOUT WHAT THEY’RE DOING, BUT THEY HAVE AN
EXTREMELY ADVANCED SPACE THERE, AND THE I.C. COMMUNITY IS
KILLING IT WHEN IT COMES TO CROWD SOURCING AND TAKING IDEAS.
SO IT JUST DEPENDS ON WHAT AGENCY YOU’RE LOOKING AT.
I KNOW SOMEONE HERE FROM THE FAA WHO LEADS THEIR IDEA WORK —
IDEA HUB, I THINK IT’S CALLED? YEA, I GOT IT RIGHT!
THERE’S ALL THESE IDEAS. SO IT JUST VARIES BETWEEN
DIFFERENT GROUPS, BUT I THINK IT DEPENDS, LIKE CIA HAS SOMETHING
WHERE IT ACTUALLY GOES INTO CHALLENGES WORK.
>>ANY OTHER QUESTION?>>HI.
MY NAME IS GRACE COLLINS AND I’M THE FOUNDER OF TELECAREGIVERS,
AND I’M AN OUTSIDE PERSON, BUT I HAVE BEEN WORKING WITH PEOPLE
FROM DEPARTMENT OF HEALTH AND HUMAN SERVICES AND OTHER FEDERAL
AGENCIES. GOING TO ALL THESE DATA PALOOZA
THINGS FOR YEARS, ALMOST FOUR YEARS.
AND I’VE GOTTEN A LOT OF BUY-IN AND PEOPLE WANTING TO HELP ME,
GIVE ME FREE ADVICE AND MENTOR SHIP, BUT THEN THERE’S THIS HRSA
MENTALITY, LIKE WE CAN’T GET CLOSER TO YOU BECAUSE IF WE KNOW
YOU, YOU CAN’T GET FUNDING, THEY KIND OF STAY AWAY FROM ME, BUT
THEN THEY WANT TO HELP ME. HOW DOES THIS PUBLIC-PRIVATE
PARTNERSHIP WORK? HOW CAN YOU GO PAST THAT?
WHERE YOU KNOW THESE PEOPLE, THEY KNOW YOU, THEY KNOW WHAT
YOUR PROJECT IS, BUT THEN THEY CAN’T HELP YOU BECAUSE THEN
THAT’S A VIOLATION OF GETTING A BRAND.
>>THIS IS SOMETHING WE TALKED ABOUT IN STARTUP WEEK THIS WEEK.
EARLIER THIS YEAR, I HAD A PANEL WHERE WE TALKED ABOUT HOW DO YOU
BRING STARTUPS INTO THE GOVERNMENT, AND THAT’S MANY
DIFFERENT WAYS ONE CAN DO THAT. AND IN INNOVATION.GOV, ONE OF
THE VERTICALS IS ENGAGING THE PUBLIC BUT IN NEW WAYS,
PUBLIC-PRIVATE PARTNERSHIP, ALIGNING COMMITMENTS, THOSE
KINDS OF THINGS. AND I GUESS IT DEPENDS ON WHAT
THE OVERALL GOAL IS FOR WORKING WITH YOUR ORGANIZATION; TO HAVE
ALMOST LIKE AN MOU IN PLACE TO WORK WITH AGENCIES AND TO LEAN
IN TO THOSE AGENCIES THAT MIGHT BE MORE FORWARD THINKING FOR
RIGHT NOW, BUT IF THERE’S AGENCIES THAT ARE A LITTLE BIT
MORE BEHIND THE TIMES, IF YOU WILL, JUST — YOU CAN POINT THEM
TO INNOVATION.GOV, YOU CAN SAY THESE ARE NEW WAYS WHERE CAN YOU
MOVE FORWARD, CERTAINLY A GOVERNMENT RESOURCE CAN YOU
POINT TO. THERE’S POLICIES OUT THERE SO A
BIG PART OF OUR TOOLKIT IS GOING TO BE 82 PAGES OUT OF 18
DIFFERENT AREAS. IT’S NOT GOING TO PUT YOU TO
SLEEP BUT IT’S ACTUALLY GOING TO BE — WE CUT IT DOWN SO THAT YOU
HAVE DISTINCT CONTENT OF EXAMPLES OF HOW IT’S BEING USED
BEFORE. POLICIES THAT SUPPORT IT, AND
ALSO ADDITIONAL RESOURCES THAT WE ACTUALLY GIVE THE THUMBS UP
ON. SO I THINK THAT MIGHT BE A GREAT
RESOURCE FOR YOU AS YOU MOVE FORWARD INTO THIS, AND JUST KEEP
TRYING. ANYBODY ELSE HAVE ANY THOUGHTS?
>>I WOULD LIKE TO THANK OUR PANEL FOR JOINING US TODAY FOR
HHS INNOVATION DAY. THANK YOU SO MUCH.
[APPLAUSE] SO LAST BUT CERTAINLY NOT LEAST,
I’D LIKE TO INTRODUCE A CLOSE COLLEAGUE AND FRIEND,
CO-DIRECTOR FOR HHS IGNITE, ALSO THE NEW LEAD FOR THE DATA
SCIENCE CONSORTIUM OR COLLABORATIVE, EXCUSE ME, AND
WILL YANG WILL BE INTRODUCING OUR DATA SCIENCE CO-LAB TEAMS,
SO WITHOUT FURTHER ADO, HERE’S WILL.
[APPLAUSE]>>HI, EVERYONE.
IT’S BEEN A LONG DAY. GOOD TO SEE ALL THE HAPPY FACES
HERE. YOU MAY KNOW ME, MY NAME IS WILL
YANG, THANKS FOR THE INTRO, KEVIN.
WHEN A FEW OF US FOUNDED HHS IGNITE IN 2013, WE HAD SET OUT
TO ENCOURAGE AND ENABLE EXPERIMENTATION AMONG THE RANKS
OF HHS STAFF WHO HAD THAT UNTAPPED DESIRE TO MAKE CHANGES,
IMPROVEMENTS, TO THE WAY THAT THEIR CORNER OF GOVERNMENT
OPERATES, OR SERVES THE PUBLIC. SO IN AN HOUR OR SO WE’LL WRAP
UP OUR SEVENTH ROUND OF IGNITE, AND AS WE WOULD HOPE OF OUR OWN
IGNITE TEAMS, WE ARE STILL LEARNING AND TRYING TO UNCOVER
VALUE, FIND UNMET NEEDS, WHICH IS PARTLY WHAT INSPIRED WHAT
WE’RE GOING TO BE WITNESSING NEXT.
SO A SPINOFF OF HHS IGNITE, THE HHS DATA SCIENCE COLAB, IS BEING
DESIGNED TO TRAIN, COACH AND ENGAGE OUR SMART, CURIOUS AND
DRIVEN COLLEAGUES TO RECOGNIZE AND BUILD THEIR OWN DATA SCIENCE
USE CASES. WHAT WE’VE BEEN CALLING THEIR
CAP STONE PROJECTS. WE ARE ASKING FOLKS TO JOIN AN
HHS WIDE COMMUNITY PRACTICE AND
RESOURCES. ALONG WITH MY DIRECTOR, MIKE
YEA, FELLOW — WE HAVE LAUNCHED AND ARE WINDING DOWN OUR PILOT
ROUND AT THE HHS DATA SCIENCE COLAB.
IN THE PAST EIGHT WEEKS, WE’VE SEEN 25 PEOPLE IN OUR PILOT,
COHORT, REALLY GUINEA PIGS, GET IMMERSED OR MORE LIKE DUNKED
INTO APPLIED TOPICS, HTML, NTSS, TEXT MINING AND NATURAL LANGUAGE
PROGRAMMING, MACHINE LEARNING AND CLASSIFICATION, AND EVEN
LATELY, REALLY INTENSE TOPICS LIKE NEURAL NETWORKS AND DEEP
LEARNING. IT’S BEEN INTENSE AND AT MANY
TIMES OVERWHELMING, TO SAY THE LEAST, TO COVER THESE MANY
TOPICS THAT OFTEN TAKE YEARS TO REALLY UNDERSTAND AND LEARN.
SO FROM AMONGST THAT GROUP WE’VE SELECT ADD SMALL BUT
REPRESENTATIVE SAMPLE, A FEW OF OUR DATA SCIENCE USE CASES AND
TOPICS THAT MOST OF US CAN RELATE TO.
HERE AT HHS, WE ALL WORK WITH DATA.
WE HAVE ACCESS TO IT OR CAN BENEFIT FROM T WE ALL WANT TO
MAKE IMPACT AT SCALE. MAKE BETTER DECISIONS OR HAVE
BETTER INSIGHTS, AND WE ALL LIKE TO LEARN WHILE DOING, MAKING
THOSE CHANGES, IMPROVEMENTS, THAT CAN IMPACT SO MANY LIVES
DOWNSTREAM. I’D LIKE TO INTRODUCE THREE
PRESENTERS WHO JOINED HHS SCIENCE COLAB WITH EXACTLY THAT
IN MIND. FIRST FROM THE HEALTH RESOURCES
AND SERVICES ADMINISTRATION, FOLLOWED BY KEITH TUCKER FROM
THE OFFICE OF THE CHIEF INFORMATION OFFICER, AND FINALLY
OUR VERY LAST PRESENTATION OF THE DAY FROM THE NATIONAL
INSTITUTES FOR MENTAL HEALTH. THANKS, CARLA.
TAKE IT AWAY.>>HI, EVERYONE.
I’M FROM THE HEALTH RESOURCES ADMINISTRATION IN THE BUREAU OF
HEALTH WORKFORCE, AND MY CAP STONE PROJECT WAS TRYING TO MAKE
CONNECTIONS BETWEEN GRANTS AND THE BUREAU OF HEALTH WORKFORCE.
THERE WERE TWO SPECIFIC KINDS OF BRANDS I LOOKED AT.
ONE WAS BRANDS GIVEN TO UNIVERSITIES, IN PARTICULAR, THE
PRIMARY CARE TRAINING AND ENHANCEMENT GRANTS, A LOT OF THE
PROGRAMS GRANTS TO UNIVERSITIES I WAS LOOKING AT ARE ENCOURAGING
PEOPLE TO WORK IN PRIMARY CARE, PARTICULARLY IN UNDERSERVED
COMMUNITIES, AND I WAS TRYING TO CONNECT THAT WITH THE NATIONAL
HEALTH CORE SERVICE PROGRAM WHICH GIVES AWARDS TO
INDIVIDUALS WHO ARE SERVING IN UNDERSERVED COMMUNITIES IN A
CLINICAL PRACTICE SETTING, SO SPECIFICALLY I WAS TRYING TO
MAKE THAT CONNECTION BETWEEN A GRANT TO A UNIVERSITY TO
ENCOURAGE PEOPLE TO GO INTO PRIMARY CARE AND THEN WHAT
HAPPENS WITH THOSE PEOPLE WHO GO INTO PRIMARY CARE AND THEN
CHOOSE TO APPLY FOR ONE OF OUR OTHER PROGRAMS.
SO REALLY IT’S QUANTIFYING THAT CONNECTION.
WE KNOW ANECDOTALLY THAT SOME LEVEL OF CONNECTION EXISTS
BETWEEN THESE UNIVERSITIES, BUT WE DON’T HAVE THE RAW NUMBERS ON
THAT. HAVING THIS CONNECTION WOULD
REALLY HELP US TELL A CONNECTED STORY ACROSS BHW.
WE GIVE GRANTS TO DIFFERENT LEVELS OF CLINICAL SERVICE FROM
THE UNDERGRADUATE AND GRADUATE EDUCATION, INTO RESIDENCY
PROGRAMS, THEN ON INTO AWARDS IN ACTUALLY SERVING IN THESE
COMMUNITIES, WE WANT TO BE ABLE TO SHOW THE IMPACT AND THE
CONNECTION ACROSS ALL OF THOSE AREAS.
ONE DOUGH NUSS OF LOOKING AT THIS PROJECT, SINCE I’M LOOKING
AT UNIVERSITY DATA, ONE OF THE FIRST THINGS I NEEDED TO DO WAS
CREATE THIS UNIQUE SET OF SCHOOLS FROM MULTIPLE DATA
SOURCE WHERE I COULD CONNECT THE SCHOOLS IN THE GRANT PROGRAM AND
THE SCHOOLS THAT ARE TIED TO OUR APPLICANTS IN A UNIQUE WAY.
SO THE DATA HAD A LOT OF ITS FOCUS ON SCHOOL — I
ALSO USED THE HRSA DATA WAREHOUSE, HRSA’S
PUBLIC-FACING SOURCE FOR ALL KINDS OF INFORMATION ON THE
PROGRAMS TO GET THAT LIST OF GRANT INFORMATION AND THEN
THROUGH AN INTERNAL BHW SOURCE I PULLED ALL THE INFORMATION ON
THE NATIONAL HEALTH SERVICE PROGRAM.
SO YOU CAN’T SEE THE DATABASE DIAGRAM HERE, EVERYTHING IS
REALLY BLURRY, BUT I WAS WORKING WITH A LOT OF CSV FILES THAT I
DOWNLOADED AND I WANTED TO WORK WITH THEM IN A MORE ORGANIZED
WAY, SO I USED A TOOL CALLED MY — WORKBENCH TO CREATE JUST
ON MY DESKTOP FOR MY OWN PERSONAL USE A FULL DATABASE FOR
THIS, DESIGNED ALL THE CONNECTIONS, EVERYTHING ON THE
APPLICANTS AND WHERE THEY WENT TO SCHOOL, I HAVE TWO DIFFERENT
DEPARTMENT OF EDUCATION SOURCES, ONE IS THEIR DATABASE OF
ACCREDITED SCHOOLS, AND THE OTHER ONE IS THE INTEGRATED POST
SECONDARY EDUCATION DATA SYSTEM WHICH CONTAINS A LOT OF
INFORMATION ON TOTAL ENROLLMENT, INSTITUTION LOCATIONS, GREAT
SOURCE, SO MANY DATASETS AVAILABLE, AND THEN THE LAST
PIECE IS HRSA GRANT DATA, INCLUDING BOTH THE INSTITUTIONS
AND THE ACTUAL GRANTS THEY RECEIVED.
AGAIN I DID A LOT OF THINGS WITH CSV FILES, NOT HUGE FILES, JUST
WANTED TO MAKE THINGS MORE ORGANIZED.
THE TOOLS I USED FOR MY PROJECT, THERE WERE THREE MAIN TOOLS.
ONE OF THEM WAS SEQUEL, I USE MIGHT SEQUEL WORKBENCH TO DO MY
DATABASE DESIGN AND I USED SOME PYTHON TOOLS TO THEN LOAD MY CSV
FILES INTO IT. WITH THE PYTHON TOOLS, ONE OF
THEM IS A TOOL CALLED CEQA ALCHEMY, WHICH HAS THE ABILITY
TO CREATE OBJECT RELATIONSHIP MAP — WHICH ARE REALLY JUST
EXTRA STEPS TO BE ABLE TO TAKE THE CSV FILE AND PUT IT INTO THE
DATABASE, BUT CLEAN THE DATA, VALIDATE EVERYTHING, ENFORCE
SOME OF THE BUSINESS RULES THAT MAY NOT BE PRESENT IN ALL THE
FILES. THE BIG TOOL I USE FOR MY
PROJECT WAS A PYTHON TOOL CALLED PANDAS, WHICH IS THE PYTHON DATA
ANALYSIS LIBRARY. I WAS ABLE TO USE THIS TO
CONNECT ALL MY PIECES OF DATA TOGETHER, QUERY EVERYTHING, DO
ALL THE ANALYSIS, ALL WITHIN THE CODE.
THESE ARE THINGS THAT PRIOR TO THE DATA COLAB, THESE ARE ALL
THINGS I CAN DO AND EXCEL. THEY TAKE A LITTLE LONGER,
THEY’RE MUCH HARDER TO SHARE WITH OTHER PEOPLE AND HARDER
TOREPRODUCE, SO THIS ALLOWED ME TO FULLY DOCUMENT THOSE
PROCESSES. THE LAST PYTHON TOOL I USED IS A
LIBRARY CALLED JELLYFISH WHICH MAKES STRING COMPARISON VERY
EASY. ONE OF THE PIECES I WANTED TO DO
WITH MY PROJECT WAS VALIDATE SOME OF MY MATCHES BASED ON ARE
THE NAMES OF THESE INSTITUTIONS THE SAME, ARE THE ADDRESSES THE
SAME, SO THIS REALLY HELPED WITH THAT.
AND THE LAST PART WAS USING MATH, I DON’T HAVE AN ADVANCED
BACKGROUND IN STATISTICS SO A LOT OF WHAT I DID FOR MY INITIAL
ANALYSIS WAS TAKING SOME OF THESE DATASETS I PULLED TOGETHER
AND JUST DOING SOME BASIC CALCULATIONS ON THE NUMBER OF
PEOPLE WHO APPEAR IN EACH DATASET, WHAT’S THE PERCENTAGE
OF THE OVERALL, SO AT LEAST INITIALLY, NOT DIVING TOO DEEP
BEYOND THAT. THE VISION FOR THIS, ONE OF THE
FIRST PIECES WAS CREATING THAT SCHOOL DATABASE.
THAT’S KIND OF THE BASIS OF EVERYTHING ELSE, AND FROM THERE,
TRYING TO VISIT THE QUESTION OF IS THE SCHOOL — PUSHING PEOPLE
INTO PRIMARY CARE IN UNDERSERVED COMMUNITIES, DOES HAVING THAT
EXPERIENCE MAKE YOU MORE LIKELY TO WORK IN THOSE COMMUNITIES
LATER AND MAKE YOU MORE LIKELY TO APPLY TO A PROGRAM LIKE THE
NATIONAL HEALTH SERVICE FOR LOAN REPAYMENT PROGRAM?
SO TO ACHIEVE THAT, I NEED TO BE ABLE TO LINK THOSE APPLICANTS TO
THE SCHOOLS THAT RECEIVED GRANTS.
BUN THING I WOULD LIKE TO BE ABLE TO DO, BECAUSE ONE OF THE
DEPARTMENT OF ED SOURCES HAS ENROLLMENT DATA, IS USE THAT TO
COME UP WITH RELATIVE RATES, COMPARE THE NUMBER OF APPLICANTS
FROM THOSE SCHOOLS TO THE OVERALL SIZE OF THE SCHOOL, AND
JUST REALLY DIVE INTO THAT IN MORE DETAIL.
SOME OF THE CHALLENGES I MAY HAVE IS, SINCE I’M USING SCHOOL
DATA FROM MULTIPLE SOURCES, THERE ARE DIFFERENT BUSINESS
IDENTIFIERS LIKE THE DUNN’S NUMBER, TAX EIN, THAT
UNDERSTANDING THOSE COMBINATIONS CAN BE A LITTLE DIFFICULT.
ONE IS THE NUMBER OF LRP STUDENTS VERSING GENERAL
STUDENTS, BUT I’M EXCITED TO SEE WHAT I FIND.
[APPLAUSE]>>HI, I’M KEITH TUCKER, OFFICE
OF THE CHIEF INFORMATION OFFICER.
MY PROJECT, IF I CAN GET THIS TO COMEUP, IS IMPROVING DISCOVERY
FOR OPEN DATA. WHAT THAT MEANS IS, WHEN PEOPLE
COME TO THE HEALTH DATA.GOV WEBSITES AND SEARCH FOR OPEN
DATASETS, I WANT TO IMPROVE THE CAPABILITIES OF SHOWING THEM
RELATED DATASETS TO WHAT THEY WERE SEARCHING FOR.
THIS IS MEANT TO SERVE TWO AUDIENCES, PRIMARILY THE
INDEPENDENT RESEARCHERS COMING TO HELP DATA.GOV LOOKING FOR
SOME DATA TO SUPPORT THEIR RESEARCH EFFORTS.
THIS IS REALLY THE WHOLE POINT OF RELEASING DATA TO THE PUBLIC
TO TRY AND GET MORE EYES ON THE PROBLEM AND HOPEFULLY HAVE
PEOPLE FIND ADDITIONAL INSIGHTS FROM THE DATA WE’VE ALREADY
COLLECTED FOR OUR OWN PURPOSES. SO THE MORE WE CAN DO TO IMPROVE
THE DISCOVERY OF THAT DATA, THE MORE CHANCES WE HAVE OF GETTING
THOSE ADDITIONAL INSIGHTS. GROUPING THE DATASETS BY TOPIC
BETTER THAN WE’RE CURRENTLY SEEING USING JUST THE KEYWORDS
THAT ARE ASSOCIATED WITH THE DATASETS.
ALSO IMPROVING THE IDENTIFICATION OF DATASETS THAT
COULD BE USED TOGETHER FOR MORE MEANINGFUL ANALYSIS.
THE SECOND AUDIENCE I’M TRYING TO SERVE IS THE PEOPLE WHO ARE
AT HHS, ACTUALLY ENTERING THE INFORMATION ON THESE OPEN
DATASETS. I WANT TO HELP THEM STANDARDIZE
THE WAY THAT WE DEFINE THOSE DATASETS AGAIN IMPROVING THE
CHANCES OF DISCOVERING THEM. SO WHAT I HAVE TO WORK WITH IS
THE INVENTORY ON THE WEBSITE FOR EACH OF THE ENTRIES IN THAT
INVENTORY, I’VE GOT A TITLE, A DESCRIPTION, AND A LIST OF
KEYWORDS. AS YOU’LL SEE, THE QUALITY OF
THAT DATA VARIES SIGNIFICANTLY. HERE WE’VE GOT A COUPLE OF
EXAMPLES WHERE THE TITLE IS PRETTY GOOD, GOOD LIST OF
KEYWORDS AND DESCRIPTIONS ARE VERY DESCRIPTIVE OF REALLY
TELLING YOU WHAT THE DATA IS ABOUT, BUT THEN WE’VE GOT A
COUPLE OTHER ENTRIES WHERE THE TITLE IS LESS INFORMATIVE, THE
KEYWORDS, THEY DON’T GIVE YOU ANY INSIGHT INTO WHAT THE DATA
IS ABOUT BUT AT LEAST THE DESCRIPTION IS STILL GOOD.
DISCLAIMER AT THIS POINT, I AM NOT TRYING TO CALL OUT CDC AND
ACF IN THIS, THEY’RE JUST A COUPLE OF EXAMPLES WHERE THE
KEYWORD LIST WAS NOT AS GOOD. SO APPLYING DATA SCIENCE, I’M
TRYING TO TAKE A TWO-PRONGED APPROACH, TAKING THE
DESCRIPTIONS OF THE DATASETS AND APPLYING CLUSTERING ALGORITHMS
TO THEM. THEN THE SECOND APPROACH, I’M
DOING A TOP DOWN APPROACH STARTING WITH A CLASSIFICATION
SCHEME, AND SOME DOCUMENTS THAT HAVE ALREADY BEEN CLASSIFIED BY
THAT SCHEME. I’LL APPLY SOME NATURAL
PROCESSING TECHNIQUES TO FIND OUT TERMS USED ON THOSE
DOCUMENTS AND TRAIN A PREDICTER THAT CAN THEN BE APPLIED TO THE
DESCRIPTIONS OF THE DATASETS TO PREDICT WHAT’S THE APPROPRIATE
CLASS FOR THE DATASET. ALONG WITH THAT, I’LL GET A LIST
OF COMMON TERMS THAT ARE IN THOSE CLASSES WHICH WE CAN USE
AS SUGGESTED KEYWORDS FOR THE DATASETS.
SO THE FINAL PRODUCT VISION HERE IS THAT WHEN SOMEONE COMES TO
HEALTHDATA.GOV AND PERFORMS A SEARCH, WE’LL SHOW THEM NOT ONLY
THE DATASETS THAT MATCH THEIR SEARCH TERMS, BUT ALL THE
DATASETS THAT WERE FOUND RELATED TO THEM THROUGH THE CLUSTERING
OF THEM. AND SECONDLY, WHEN PEOPLE COME
TO ENTER NEW DATASETS IN THE OPEN DATA INVENTORY, WE’LL
PRESENT THEM WITH A LIST OF SUGGESTED KEYWORDS THAT THEY CAN
THEN DECIDE WHETHER OR NOT THEY’RE REALLY APPROPRIATE FOR
THAT DATASET. AND THOSE KEYWORDS WILL BE DRAWN
FROM A STANDARDIZED LIST SO THAT WE’LL BE GETTING A BETTER
QUALITY OF THE CONSISTENCY ACROSS THE DIFFERENT DATASETS.
SO FAR I HAVE FOUND COMMON TERMS —
USING A META THESAURUS BY THE NATIONAL LIBRARY OF
MEDICINE THIS IS REALLY A VALUABLE RESOURCE IN THIS
EFFORT. NOT ONLY DOES IT CONTAIN A
CROSS-REFERENCE OF A LOT OF DIFFERENT MEDICAL TERMS BUT IT
DEFINES A PREFERRED TERM FOR EVERY CONCEPT THAT LETS ME
NORMALIZE ALL THE DIFFERENT DESCRIPTIONS ACROSS THE OPEN
DATA INVENTORY AND IMPROVES THE CHANCES OF FINDING COMMON DATA
CONCEPTS. SO MY NEXT STEPS ARE TO TAKE
THAT PROCESS TEXT AND APPLY IT TO THE DIFFERENT CLUSTERING
ALGORITHMS TO SEE JUST HOW WELL THEY PERFORM.
A LONGER TERM EFFORT IS THAT TOP-DOWN APPROACH WHERE I’LL
ACTUALLY HAVE TO DEFINE A CORPUS OR COLLECTION OF DOCUMENTS TO
USE FOR TRAINING THE CLASS FIRE. IT NOT PRACTICAL FOR ME TO USE
EVERYTHING IN PUBMED CENTRAL, FOR EXAMPLE, EVEN THOUGH THAT IS
A GOOD BODY OF DOCUMENTS THAT HAVE BEEN ALREADY CLASSIFIED BY
SUBJECT MATTER EXPERTS, IT’S JUST TOO LARGE TO ACTUALLY
CONDUCT THE TRAINING, SO MY EFFORTS FROM THIS POINT WILL BE
TO TRY AND FIND A SMALLER SET OF DOCUMENTS THAT STILL GIVES ME A
GOOD TRAINING SET AND RELIABLY COMES UP WITH CLASSIFICATIONS TO
ASSIGN TO THE DATASETS. THANKS.
[APPLAUSE]>>OVER THE LAST EIGHT WEEKS,
I’VE BEEN WORKING ON A PROJECT TO USE SUPERVISED MACHINE
LEARNING FOR THE PURPOSE OF CODING GRANTS.
I WANT TO TELL YOU A LITTLE ABOUT THAT.
SO GRANTS ARE BASICALLY BIG BODIES OF UNSTRUCTURED TEXT.
RESEARCHERS BASICALLY COME UP ABOUT IDEAS TO TEST EXPERIMENTS
AND THEY WRITE UP THOSE IDEAS IN THE FORM OF GRANT APPLICATIONS
BY ARE 10 TO 20 PAGES LONG ROUGHLY AND THEY SEND THEM TO
NIH TO BE FUNDED OR TO APPLY FOR FUNDING.
THEN ONCE NIH RECEIVES THEM, THEY ASSIGN CODE FOR THEM WHICH
ARE STRUCTURAL ELEMENTS LIKE MICE, AUTISM, OR ADULTS, SO WE
CAN FIGURE OUT WHAT’S HAPPENING IN THOSE GRANTS MORE EASILY THAN
HAVING TO READ THROUGH THEM MANUALLY, WHICH SAVES SOME TIME.
THEN ONCE THAT’S DONE, EVERY GRANT IS SENT TO AN INSTITUTE
WITHIN NIH, IN MY CASE, NATIONAL INSTITUTE OF MENTAL HEALTH,
WHERE A PROGRAM OFFICER WHO IN CHARGE OF KEEPING TRACK OF IT
DURING THE LIFE CYCLE — READ THROUGH THEM MANUALLY WORD FOR
WORD AND ADD THESE STRUCTURAL ELEMENT.
SO MY GOAL THROUGH THE COLAB WAS TO AUTOMATE THIS PROCESS USING
SUPERVISED MACHINE LEARNING, AND TO ACHIEVE MY VISION OF ONE
CLICK CODING FOR GRANTS. SO EARLIER THIS YEAR, I WAS
TASKED WITH ASSIGNING SOME OF THESE CODES TO GRANTS, AND FIRST
I STARTED OUT BY DOING IT WORD FOR WORD, THEN I QUICKLY
REALIZED THAT’S GOING TO TAKE FOREVER, THEN I TRIED SKIMMING
IT, BUT I REALIZED I WAS MISSING A LOT OF INFORMATION, AND ON TOP
OF THAT, I REALIZED I DIDN’T KNOW THE SUBJECT OF ALL THE
GRANTS BELL ENOUGH TO CAPTURE EVERYTHING ACCURATELY.
SO THREE PROBLEMS ARE THAT IT’S TIME-INTENSIVE, IT REQUIRES
FAMILIARITY WITH THE SUBJECT AND REQUIRES READING THE CONTEXT TO
DO IT WELL. SO FOR THE EXAMPLE, ONE OF THE
METHODS I TRIED TO SPEED UP THE PROCESS WAS JUST USING CONTROL F
TO FIND RELEVANT KEYWORDS. THERE’S POSITIVE USE CASES AND
NEGATIVE USE CASES SO FOR AN EXAMPLE, POSITIVE USE CASE WOULD
BE IF WE’RE TRYING TO FIGURE OUT IF THE GRANT APPLICATION IS
RELEVANT TO THE CURE FOR AUTISM, LET’S SAY, THEY MAY SAY WE’RE
MEASURING THE EFFECTS OF X ON Y TO DETERMINE IF X IS LINKED TO
AUTISM. IN A NEGATIVE USE CASE, THEY MAY
SAY THE EFFECT OF X ON Y IN THE CONTEXT OF AUTISM WAS ALSO
STUDIED BY OTHERS. SO CONTROL F DOESN’T WORK
BECAUSE THE NEGATIVE USE CASES GIVE YOU A LOT OF NOISE.
SO WHAT REALLY HAD TO BE DONE WAS LOOKING AT THE CONTEXT AND
LUCKILY WE FOUND A WAY THAT THE MACHINE COULD DO IT FOR US.
SO IF YOU DO THE MATH, THIS TAKES A LONG TIME.
THIS IS ASHLEY. ASHLEY WORKS DOWN THE HALL FROM
ME AND SHE ALSO HAD TO CODE SOME GRANTS RECENTLY SO I ASKED HER
JUST TO GET AN IDEA IF IT’S JUST ME FACING THIS PROBLEM OR OTHERS
TOO. SHE SAID RECENTLY SHE HAD TO
CODE OVER 1600 GRANTS AND IT TOOK HER AT LEAST 30 SECONDS PER
GRANT MINIMUM WHICH TOOK OVER 13 HOURS.
AND SHE TOLD ME SHE WAS PULLING HER HAIR OUT OVER IT, IT WAS SO
PAINFUL. SO WHAT I THOUGHT WAS IF WE
COULD AUTOMATE THIS, WE COULD SAVE A BUNCH OF TIME AT THE VERY
LEAST. SO NE COLAB, WE USED A RANDOM
FORCE CLASS FIRE, WE DID SOME NATURAL LANGUAGE PROCESSING TO
PREPROCESS THE TEXT TO MAKE IT COMPATIBLE WITH THE CLASSIFIER
AND THEN WE BUILD A WEB APPLICATION WITH TWO BUTTONS,
ONE WAS UPLOAD A FILE BUTTON, SO YOU HAVE YOUR LIST OF GRANTS
WITH THE FULL TEXT, AND THE OTHER WAS DOWNLOAD A FILE
BUTTON, ONCE THE GRANTS RAN THROUGH OUR PIPELINE AND GAVE
YOU THE RESULTS. AN OUTPUT OF THAT WAS THE GRANT
WHICH YOU SEE ABOVE ALONG WITH THE STRUCTURE, WHICH ARE THE
CODES. SO NOW WE HAVE A QUICK AND DIRTY
WAY OF JUST GETTING ALL INFORMATION WE NEED THAT’S
RELEVANT TO THE GRANTS IN ORDER TO KEEP A QUICK TRACK OF WHAT’S
HAPPENING IN THEM. SO THIS SAVED — THE TIME THIS
SAVED WAS PRETTY SIGNIFICANT, ASHLEY WAS HAPPY, WE CUT COUNCIL
THE 13 1/2 HOURS TO JUST A FEW MINUTES AND OUR INITIAL RESULTS
SHOWED THAT WE COULD DO IT WITH PRETTY GREAT PRECISION, 98%.
I INTERVIEWED 15 PEOPLE AT 12 DIFFERENT INSTITUTES WITHIN NIH
TO FIGURE OUT IF THEY WERE DEALING WITH THIS ISSUE TOO OR
MAYBE THEY HAD A SOLUTION. SO I FOUND OUT IT COST EACH
INSTITUTE I INTERVIEWED AT LEAST AN AVERAGE OF $300,000 PER YEAR,
WHICH IS A CONSIDERABLE AMOUNT OF MONEY THAT COULD BE SAVED IF
YOU AUTOMATE THE PROCESS. SO THE POTENTIAL IMPACT THEN IS
THE TIME SAVING AND THEN ALSO, BECAUSE TEAMS OF HUMANS CODE THE
GRANTS, YOU MAY SIGN A CERTAIN CODE AND I MAY ASSIGN A
DIFFERENT CODE AND THEN WE DISAGREE AND SAY HEY, THIS CODE
ISN’T RELEVANT OR IT IS RELEVANT, SO AUTOMATING IT TAKES
AWAY THAT VARIABILITY BETWEEN CODERS BECAUSE IT AVERAGES THE
DATA FROM FIVE OR 10 YEARS OF CODES BEING ASSIGNED, AND THEN
ALL OF A SUDDEN YOU HAVE THE ABILITY WITH THOSE CODES CREATED
FOR THESE OLD GRANTS TO COMPARE A PORTFOLIO BETWEEN, LET’S SAY,
2005, 2008, AND 2012 AND 2016. SO WITH THOSE FINDINGS YOU CAN
CREATE THOSE GRAFTS AND AT ANY TIME WHEN LEADERSHIP ASKS YOU TO
CODE OVER 100 GRANTS, YOU CAN SAY — AUTISM IN THESE YEARS TO
SPENDING WHY AMOUNT OF DOLLARS TOWARDS FINDING THE CURE FOR
AUTISM IN THIS PERIOD OF YEARS. SO BASICALLY IN THE COLAB, I
LEARNED HOW TO DO SOME COOL PROGRAMMING, HOW TO BUILD A WEB
APPLICATION, HOW TO INTEGRATE THEM TOGETHER TO MAKE THIS TOOL
WORK. OUR INITIAL RESULTS SHOWED SOME
PRETTY COOL FINDINGS, WE WERE ABLE TO DO IT PRETTY ACCURATELY,
AND MY NEXT STEP IS TO TAKE THIS BACK TO NIMH WHERE I WORK AND
DEMO IT FOR THEM AND HOPEFULLY THEY’LL LIKE IT AND WE CAN
IMPLEMENT IT. THANK YOU.
[APPLAUSE]>>THANK YOU.
AS I CLOSE OUT TODAY, I JUST WANT TO RECAP A FEW THINGS THAT
I THINK WERE OF PARTICULAR HIGHLIGHTS FOR US AT HHS
INNOVATION DAY. THE FIRST OF WHICH IS WE HEARD
FROM OUR CHIEF TECHNOLOGY OFFICER HERE AT HHS, BRUCE
GREENSTEIN, AND HE SHARED HIS VISION AND OUR HOPE FOR
ACHIEVEMENTS IN THE NEAR FUTURE HERE AT HHS IN ORDER TO
DISSEMINATE BETTER INNOVATION THROUGHOUT THE PUBLIC SECTOR
WITHIN HEALTHCARE AND HUMAN SERVICES.
WE THEN HEARD FROM MICHAEL KRATSIOS, DEPUTY ASSISTANT TO
THE PRESIDENT, WHO FOCUSED ON SHARING THIS ADMINISTRATION’S
AGENDA AROUND SCIENCE TECHNOLOGY AND INNOVATION.
WE HEARD FROM 14 OF OUR HHS IGNITE TEAMS WHO SHARED HOW THEY
USED LEAN STARTUP AND DESIGN THINKING METHODOLOGIES IN
ACTIONS TO IMPLEMENT BETTER PUBLIC HEALTH INTERVENTIONS,
PROCESS IMPROVEMENTS OR EXPERIENCE FOR THE AMERICAN
CITIZEN. WE HEARD FROM DR. RASU SHRESTHA,
THE UPMC CHIEF INNOVATION OFFICER, WHO SHARED WITH US HIS
VISION FOR HEALTHCARE, TECHNOLOGY AND INNOVATION.
WE HEARD FROM MATT LIRA, THE WHITE HOUSE OFFICE OF AMERICAN
INNOVATION AROUND MODERNIZING GOVERNMENT AND GOVERNMENT
TECHNOLOGY. WE HEARD FROM DEAN CHANG AT THE
UNIVERSITY OF MARYLAND AND OUR PARTNER HERE AT THE IDEA LAB,
WHO SHARED WITH US AN ARTICULATED VERSION OF THE JERRY
MAGUIRE VALUE PROPOSITION THAT SATISFIES ALL OF THE CUSTOMER
ECOSYSTEM. WE HEARD FROM MORGAN PLUMMER,
MD5 AT THE NATIONAL SECURITY AGENCY.
WE HEARD A PANELIST OF SUCCESS STORIES THAT HAVE COME THROUGH
THE IDEA LAB PROGRAMS OVER THE YEARS, AND JUST RECENTLY WE
LISTENED TO THE DATA SCIENCE COLAB INITIATIVE.
SO I WANT TO THANK ALL OF YOU THAT WERE HERE IN PERSON, THAT
BRAVED THE COLD TODAY, I WANT TO THANK ALL OF YOU THAT WERE
LISTENING IN WATCHING VIA THE LIVE STREAM, PLEASE DO STAY
TUNED FROM THE HHS CHIEF TECHNOLOGY OFFICE AND IDEA LAB
AS WE LOOK TO LAUNCH ONE OF OUR NEW INITIATIVES, OUR HHS STARTUP
DAY, ON FEBRUARY 5TH HERE IN WASHINGTON, D.C., HERE IN THIS
VERY GREAT HALL. LET’S SEE, WHAT ELSE DO WE HAVE?
MY HHS IGNITE TEAM, IF YOU COULD MEET WILL AND MYSELF IN THE
AUDITORIUM AT THE CLOSE, WHICH IS JUST TO THE RIGHT HERE, SO
JUST BEYOND THE DIVIDER AND TO THE RIGHT.
CERTAINLY LAST BUT NOT LEAST, WE WILL HEAD OVER TO HAWK AND DOVE
IN SHORT ORDER FOR A RECEPTION, SO PLEASE FEEL FREE TO JOIN US
THERE. THANKS AGAIN, ALL.
THANKS, EVERYBODY. [APPLAUSE]

Leave a Reply

Your email address will not be published. Required fields are marked *