Code

Genai speech to form#3666

Code

Open

lincmba wants to merge 79 commits intomainopensrp/fhircore:mainfrom genai-speech-to-formopensrp/fhircore:genai-speech-to-formCopy head branch name to clipboard

+5,037-191

Commits

Commits on Dec 18, 2024

• Initial commit

  lincmba

  committed
  35df359

  Copy full SHA for 35df359

Commits on Dec 19, 2024

• Add dependencies

  lincmba

  committed
  4577857

  Copy full SHA for 4577857

• Transcribe an audio file to text using Google Cloud Speech-to-Text API

  lincmba

  committed
  1edcc9b

  Copy full SHA for 1edcc9b

Commits on Dec 20, 2024

• Gemini client

  lincmba

  committed
  b27d2ee

  Copy full SHA for b27d2ee

• TextToForm code

  lincmba

  committed
  b7f5246

  Copy full SHA for b7f5246

• remove validation

  lincmba

  committed
  95082b8

  Copy full SHA for 95082b8

• SpeechToForm class

  lincmba

  committed
  2132410

  Copy full SHA for 2132410

Commits on Dec 28, 2024

• add genai lib, mock gemini class with it

  pld

  committed
  320f599

  Copy full SHA for 320f599

• use suspend, rename to model, update template

  pld

  committed
  beb8023

  Copy full SHA for beb8023

Commits on Jan 7, 2025

• Add unit tests

  lincmba

  committed
  226b6c6

  Copy full SHA for 226b6c6

• Add lisences, clean up

  lincmba

  committed
  43cf89d

  Copy full SHA for 43cf89d

• Merge branch 'main' into genai-speech-to-form

  pld

  authored
  d6ea238

  Copy full SHA for d6ea238

• fix tests

  pld

  committed
  9c922bb

  Copy full SHA for 9c922bb

• expand docs

  pld

  committed
  94c2ec3

  Copy full SHA for 94c2ec3

Commits on Jan 8, 2025

• Allow for GEMINI_API_KEY to be passed as project property

  lincmba

  committed
  650a97f

  Copy full SHA for 650a97f

• Update SpeechToForm to use GeminiModel in instantiating TextToForm

  Show description for 7f81ed6
  lincmba

  committed
  7f81ed6

  Copy full SHA for 7f81ed6

• Clean up temp file after test

  lincmba

  committed
  c52f396

  Copy full SHA for c52f396

• Add option to run tests bu hitting the actual API

  lincmba

  committed
  8a83431

  Copy full SHA for 8a83431

• Update method name to avoid conflict

  lincmba

  committed
  27d8c85

  Copy full SHA for 27d8c85

Commits on Jan 9, 2025

• pull out qr validation

  pld

  committed
  982399f

  Copy full SHA for 982399f

• QR generation retry logic incase of errors.

  Show description for 04f564e
  lincmba

  committed
  04f564e

  Copy full SHA for 04f564e

• Address changes

  lincmba

  committed
  89591e7

  Copy full SHA for 89591e7

• Add test audio file

  lincmba

  committed
  edad7a5

  Copy full SHA for edad7a5

• move to new package structure and abstract models

  pld

  committed
  daf936a

  Copy full SHA for daf936a

• match tests to new abstractions

  pld

  committed
  064082b

  Copy full SHA for 064082b

• turn class into interface, do not override autogen getter

  pld

  committed
  106b04c

  Copy full SHA for 106b04c

• retry if not able to extract response, always return a qr

  pld

  committed
  0b757ee

  Copy full SHA for 0b757ee

Commits on Jan 10, 2025

• refactor some constants

  pld

  committed
  32afdd3

  Copy full SHA for 32afdd3

• Add sample transcript

  lincmba

  committed
  9b5058d

  Copy full SHA for 9b5058d

Commits on Jan 15, 2025

• rename packages and add outline of summarize class

  pld

  committed
  0b7aef7

  Copy full SHA for 0b7aef7

Commits on Jan 16, 2025

• add scaffold for live speech to text

  pld

  committed
  fdd6ea0

  Copy full SHA for fdd6ea0

• Refine model layer abstraction.

  Show description for 9a32159
  lincmba

  committed
  9a32159

  Copy full SHA for 9a32159

• Refactor dispatcher.

  lincmba

  committed
  eb6b31b

  Copy full SHA for eb6b31b

• Convert Speech to text to an object.

  Show description for f7edcdd
  lincmba

  committed
  f7edcdd

  Copy full SHA for f7edcdd

• refactor TextToForm to an object. Utilize refactored models.

  Show description for 56ddbe6
  lincmba

  committed
  56ddbe6

  Copy full SHA for 56ddbe6

• Update tests

  lincmba

  committed
  d1b202a

  Copy full SHA for d1b202a

• fix summarize and remove wildcard

  pld

  committed
  fa4c1db

  Copy full SHA for fa4c1db

• Merge branch 'main' into genai-speech-to-form

  pld

  authored
  5857b95

  Copy full SHA for 5857b95

• spotless

  pld

  committed
  73316df

  Copy full SHA for 73316df

Commits on Jan 20, 2025

• Resolved issues making build fail:

  Show description for a5c2034
  lincmba

  committed
  a5c2034

  Copy full SHA for a5c2034

Commits on Jan 21, 2025

• Additional sample test files

  lincmba

  committed
  7e6decc

  Copy full SHA for 7e6decc

• Use real files TextToForm tests

  lincmba

  committed
  ba8e234

  Copy full SHA for ba8e234

• Add grpc-okhttp dependency needed by google cloud speech

  lincmba

  committed
  6aa97b3

  Copy full SHA for 6aa97b3

• Switch transcription to only transcribe wav files as recommended.

  lincmba

  committed
  8351741

  Copy full SHA for 8351741

• Improve SpeechToTextTest to only mock api calls but use real files

  lincmba

  committed
  10b62d1

  Copy full SHA for 10b62d1

• Add sample conversation.wav file

  lincmba

  committed
  707d332

  Copy full SHA for 707d332

• Handle edge case in retryLogic where QR, QRJson of generatedText could be blank

  Show description for 4813848
  lincmba

  committed
  4813848

  Copy full SHA for 4813848

• Gnerate Summary initial work and tests

  lincmba

  committed
  21b0b73

  Copy full SHA for 21b0b73

Commits on Jan 22, 2025

• Resolve tests failure caused by refactoring QuestionnaireResponseValidator

  lincmba

  committed
  dfa738e

  Copy full SHA for dfa738e

• Merge branch 'main' into genai-speech-to-form

  pld

  authored
  62c21ec

  Copy full SHA for 62c21ec

Commits on Jan 24, 2025

• Add SpeechToext fragment views

  LZRS

  committed
  392b7a6

  Copy full SHA for 392b7a6

• add starter gemma model

  pld

  committed
  3fcf0d9

  Copy full SHA for 3fcf0d9

Commits on Jan 27, 2025

• Update questionnaire form on new QuestionnaireResponse

  LZRS

  committed
  3933615

  Copy full SHA for 3933615

• Refactor showing progress dialog in Questionnaire activity

  LZRS

  committed
  abb6c00

  Copy full SHA for abb6c00

• Show record button

  LZRS

  committed
  c449423

  Copy full SHA for c449423

• Toggle record button and show speech-to-text 'window'

  LZRS

  committed
  9efb42d

  Copy full SHA for 9efb42d

Commits on Jan 28, 2025

• Exclude protobuf-javalite to fix duplicated classes error

  Show description for 9fec7b3
  LZRS

  committed
  9fec7b3

  Copy full SHA for 9fec7b3

• Add record-audio permission before lauching speech to text

  LZRS

  committed
  de19098

  Copy full SHA for de19098

• Simulate stop recording processing progress view

  LZRS

  committed
  7b5bf14

  Copy full SHA for 7b5bf14

Commits on Jan 29, 2025

• add tests, fix style

  pld

  committed
  a730274

  Copy full SHA for a730274

• set type and create constants

  pld

  committed
  0a2f42a

  Copy full SHA for 0a2f42a

• Integrate to TextToForm api with Gemini

  LZRS

  committed
  34c89a2

  Copy full SHA for 34c89a2

• Show edit button to exit speech-to-text without updating form

  LZRS

  committed
  098d80e

  Copy full SHA for 098d80e

Commits on Jan 30, 2025

• Merge branch 'main' into genai-speech-to-form

  LZRS

  authored
  b3a4b3c

  Copy full SHA for b3a4b3c

Commits on Jan 31, 2025

• Merge branch 'main' into genai-speech-to-form

  pld

  authored
  c0f18bf

  Copy full SHA for c0f18bf

• Integrate speech-to-text to call cloud speech-to-text api

  LZRS

  committed
  d3a4087

  Copy full SHA for d3a4087

• Fix errors in tests

  LZRS

  committed
  47ca179

  Copy full SHA for 47ca179

• Merge branch 'main' into genai-speech-to-form

  LZRS

  authored
  b9c961e

  Copy full SHA for b9c961e

• Merge branch 'main' into genai-speech-to-form

  LZRS

  authored
  a799897

  Copy full SHA for a799897

Commits on Feb 3, 2025

• Fix failing tests for QuestionnaireViewModel

  LZRS

  committed
  90b8d3a

  Copy full SHA for 90b8d3a

• Merge branch 'main' into genai-speech-to-form

  LZRS

  authored
  7c4a47e

  Copy full SHA for 7c4a47e

• Latest working changes - add build variant

  f-odhiambo

  committed
  561edc4

  Copy full SHA for 561edc4

• Run spotless

  LZRS

  committed
  7acdd61

  Copy full SHA for 7acdd61

• Merge remote-tracking branch 'origin/main' into genai-speech-to-form

  LZRS

  committed
  5231b9d

  Copy full SHA for 5231b9d

• Add enableSpeechToText to questionnaire config

  LZRS

  committed
  95daf5d

  Copy full SHA for 95daf5d

Commits on Feb 5, 2025

• Merge branch 'main' into genai-speech-to-form

  f-odhiambo

  authored
  94f0a84

  Copy full SHA for 94f0a84

Commits on Feb 6, 2025

• Edit GemmaModel class to allow test

  LZRS

  committed
  8248eec

  Copy full SHA for 8248eec

Commits on Feb 13, 2025

• Merge remote-tracking branch 'origin/main' into genai-speech-to-form

  LZRS

  committed
  89e840f

  Copy full SHA for 89e840f

Commits on Feb 21, 2025

• Merge branch 'main' into genai-speech-to-form

  f-odhiambo

  authored
  03a995f

  Copy full SHA for 03a995f