Use Google Cloud Speech API to Transcribe Large Video Files

Large video files can now be transcribed in English, Russian, Polish, and other languages by artificial intelligence with astounding levels of accuracy. It would be interesting to compare its accuracy to that of a professional transcriptionist. Looking forward, the next thing to work on with artificial intelligence is the ability to add punctuation and capitalize as appropriate.

If you want to use the Google Speech API for over 60 seconds, follow the linux procedure I developed below.

First, we need to convert your video file into the right format. It needs to be in mono and not stereo, and ideally in Free Lossless Audio Codec (#FLAC) format.
- Download and install FFmpeg.
- Kill two birds with one stone by converting to a mono FLAC by navigating to the directory where our video file is and typing the following into the terminal:
```
ffmpeg -i [YOUR_VIDEO_FILENAME].[EXTENSION] -ac 1 mono.flac
```
Your output file will probably be huge. If your internet connection isn't the fastest, you're going to want to break it up into bite-sized chunks. The following code will break it up into 5 minute (300 second) pieces in a separate directory:
```
mkdir chunks
ffmpeg -i mono.flac -f segment -segment_time 300 -c copy chunks/out%03d.flac 
```
Now, you'll need to set up a Google Cloud Platform (#GCP) account. You'll probably come out ahead by doing so, as new accounts usually get $300 worth of free credit. Go sign up!
Create or select a Google Cloud Platform project to use the Speech API with. Follow the instructions here.
Go ahead and install the Google Cloud Software Development Kit (SDK)
Initialize the software development kit by typing:
```
gcloud init
```
Follow the prompts and select your project.
If you haven't downloaded the JavaScript Object Notation (JSON) key already, go back to step 2 and make sure to do so. Now we're going to active it. Type the path to the key in place of [PATH] below.
```
gcloud auth activate-service-account --key-file=[PATH]
```
Remember all those chunks of your file we made? Time to upload them to the Google Cloud. Go to the Buckets Browser and create a bucket for our project. Upload the "chunks" folder from your local directory.

Copy and paste the following code into a text or code editor.

#transcribe.py

#!/usr/bin/env python
# Copyright 2017 Google Inc. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
#      http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

"""Google Cloud Speech API sample application using the REST API for batch
processing.
Example usage:
    python transcribe.py resources/audio.raw
    python transcribe.py gs://cloud-samples-tests/speech/brooklyn.flac
"""

# [START import_libraries]
import argparse
import io
# [END import_libraries]



def transcribe_gcs(gcs_uri):
    """Asynchronously transcribes the audio file specified by the gcs_uri."""
    from google.cloud import speech
    from google.cloud.speech import enums
    from google.cloud.speech import types
    client = speech.SpeechClient()

    audio = types.RecognitionAudio(uri=gcs_uri)
    config = types.RecognitionConfig(
        encoding=enums.RecognitionConfig.AudioEncoding.FLAC,
        sample_rate_hertz=48000,
###Replace en-US with the appropriate language code!
        language_code='en-US')

    operation = client.long_running_recognize(config, audio)

    print('Waiting for operation to complete...')
    response = operation.result(timeout=90)




    # Each result is for a consecutive portion of the audio. Iterate through
    # them to get the transcripts for the entire audio file.
    for result in response.results:
        # The first alternative is the most likely one for this portion.
        print('Transcript: {}'.format(result.alternatives[0].transcript))
        print('Confidence: {}'.format(result.alternatives[0].confidence))

### Following added March 2018 to save output to transcript.txt
        with open("transcript.txt", "a") as f:
            f.write(result.alternatives[0].transcript)



#Following added March 2018
#Please replace "name" and edit file paths appropriate.

transcribe_gcs("gs://name/chunks/out000.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 5 minutes \n\n\n")

transcribe_gcs("gs://name/chunks/out001.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 10 minutes \n\n\n")

transcribe_gcs("gs://name/chunks/out002.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 15 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out003.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 20 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out004.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 25 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out005.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 30 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out006.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 35 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out007.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 40 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out008.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 45 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out009.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 50 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out010.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 55 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out011.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 60 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out012.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 65 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out013.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 70 minutes \n\n\n")  

transcribe_gcs("gs://name/chunks/out014.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 75 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out015.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 80 minutes \n\n\n")    

transcribe_gcs("gs://name/chunks/out016.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 85 minutes \n\n\n")    
  
transcribe_gcs("gs://name/chunks/out017.flac")        
with open("transcript.txt", "a") as f:
    f.write("\n\n\n 90 minutes \n\n\n")    

#end of modifications 


if __name__ == '__main__':
    parser = argparse.ArgumentParser(
        description=__doc__,
        formatter_class=argparse.RawDescriptionHelpFormatter)
    parser.add_argument(
        'path', help='File or GCS path for audio file to be recognized')
    args = parser.parse_args()
    if args.path.startswith('gs://'):
        transcribe_gcs(args.path)
    else:
        transcribe_file(args.path)

Be sure to replace "name" in every "gs://name/chunks/" with the name you picked. Check Buckets Browser if you forgot.
Replace "en-US" with the appropriate language code. For example, "uk-UA" for Ukrainian, "ru-RU" for Russian, and "pl-PL" for Polish. For more language codes, see the official list.
Save the modified code as transcribe.py

Ready? Set? Run the script:
```
python transcribe.py
```
Let it run. The script has been modified above in kind of a ghetto way, but anything fancier will get you an "over the quota" error message. Take a deep breath, wait a while, and once it's ready, open up transcript.txt and get to work proofreading your transcription!

Pete's Slavic Artificial Intelligence Neural Machine Translation NLP Lab

Use Google Cloud Speech API to Transcribe Large Video Files

Comments

Post a Comment