FFmpegFrameRecorder recorder?.start() Hangs Indefinitely

[nick2525]

I am experiencing an issue where FFmpegFrameRecorder.start() hangs indefinitely when trying to start an RTSP stream. The issue occurs consistently and prevents the stream from being established.

Steps to Reproduce:

Initialize FFmpegFrameRecorder with the following settings:
kotlin
Copy code
val screenSize = Toolkit.getDefaultToolkit().screenSize
val recorder = FFmpegFrameRecorder("rtsp://0.0.0.0:8556/live", screenSize.width, screenSize.height).apply {
format = "rtsp"
videoCodec = avcodec.AV_CODEC_ID_H264
audioCodec = avcodec.AV_CODEC_ID_AAC
frameRate = 30.0
videoBitrate = 2000000
audioBitrate = 192000
interleaved = true
maxDelay = 500000
option("rtsp_transport", "tcp")
}
Call recorder.start().
The call to recorder.start() hangs indefinitely.
Expected Behavior:
The recorder should start without hanging, allowing the RTSP stream to be established.

Environment:

JavaCV version: 1.5.6
FFmpeg version: 4.4-1.5.6
OS: [Your Operating System]
JDK version: [Your JDK version]
Additional Information:
I have initialized the FFmpeg network components before starting the recorder. Here is the complete code used to reproduce the issue:

kotlin
Copy code
import org.bytedeco.ffmpeg.global.avcodec
import org.bytedeco.ffmpeg.global.avformat
import org.bytedeco.ffmpeg.global.avutil
import org.bytedeco.javacpp.Loader
import org.bytedeco.javacv.FFmpegFrameRecorder
import org.bytedeco.javacv.Java2DFrameConverter
import java.awt.Rectangle
import java.awt.Robot
import java.awt.Toolkit
import java.awt.image.BufferedImage
import javax.sound.sampled.*
import kotlin.concurrent.thread
import java.nio.ByteBuffer
import java.nio.ShortBuffer

class JvmRtspServer {

private var recorder: FFmpegFrameRecorder? = null

fun start() {
    thread { 
        mainStartRtsp() 
    }

    // Delay to ensure RTSP server starts
    Thread.sleep(2000)

    // Initialize FFmpeg libraries
    try {
        Loader.load(avutil::class.java)
        Loader.load(avcodec::class.java)
        Loader.load(avformat::class.java)
        avformat.avformat_network_init()
        println("FFmpeg network initialized")
    } catch (e: Exception) {
        e.printStackTrace()
        return
    }

    // Initialize the recorder
    try {
        val screenSize = Toolkit.getDefaultToolkit().screenSize
        recorder = FFmpegFrameRecorder("rtsp://0.0.0.0:8556/live", screenSize.width, screenSize.height).apply {
            format = "rtsp"
            videoCodec = avcodec.AV_CODEC_ID_H264
            audioCodec = avcodec.AV_CODEC_ID_AAC
            frameRate = 30.0
            videoBitrate = 2000000
            audioBitrate = 192000
            interleaved = true
            maxDelay = 500000
            option("rtsp_transport", "tcp")
        }
        recorder?.start()
        println("FFmpegFrameRecorder started")
    } catch (e: Exception) {
        e.printStackTrace()
        return
    }

    // Delay to ensure the recorder starts
    Thread.sleep(1000)

    // Capture audio
    val audioLine = captureAudio()
    val audioFormat = audioLine.format
    val bufferSize = audioFormat.frameSize * audioFormat.sampleRate.toInt() * 2
    val audioBuffer = ByteArray(bufferSize)
    val converter = Java2DFrameConverter()

    // Capture and stream screen
    thread {
        while (true) {
            try {
                val image = captureScreen()
                if (image != null) {
                    val frame = converter.convert(image)
                    if (frame != null) {
                        recorder?.record(frame)
                        println("Frame recorded successfully")
                    } else {
                        println("Failed to convert image to frame")
                    }
                } else {
                    println("Failed to capture screen image")
                }
                Thread.sleep((1000 / recorder!!.frameRate).toLong())
            } catch (e: Exception) {
                e.printStackTrace()
            }
        }
    }

    // Capture and stream audio
    thread {
        while (true) {
            try {
                val bytesRead = audioLine.read(audioBuffer, 0, audioBuffer.size)
                if (bytesRead > 0) {
                    val audioSamples = ShortArray(bytesRead / 2) // 2 bytes per sample for 16-bit audio
                    ByteBuffer.wrap(audioBuffer).asShortBuffer().get(audioSamples)
                    val shortBuffer = ShortBuffer.wrap(audioSamples)
                    recorder?.recordSamples(audioFormat.sampleRate.toInt(), audioFormat.channels, shortBuffer)
                    println("Audio samples recorded successfully")
                }
            } catch (e: Exception) {
                e.printStackTrace()
            }
        }
    }
}

private fun captureScreen(): BufferedImage? {
    return try {
        val screenRect = Rectangle(Toolkit.getDefaultToolkit().screenSize)
        Robot().createScreenCapture(screenRect)
    } catch (e: Exception) {
        e.printStackTrace()
        null
    }
}

private fun captureAudio(): TargetDataLine {
    return try {
        val format = AudioFormat(44100.0f, 16, 2, true, false)
        val info = DataLine.Info(TargetDataLine::class.java, format)
        val line = AudioSystem.getLine(info) as TargetDataLine
        line.open(format)
        line.start()
        println("Audio line opened and started")
        line
    } catch (e: Exception) {
        e.printStackTrace()
        throw RuntimeException("Failed to capture audio")
    }
}

// Mock function to start RTSP server. Replace with actual implementation.
fun mainStartRtsp() {
    println("RTSP server started")
}

}

// Main function to create and start the RTSP server
fun main() {
val server = JvmRtspServer()
server.start()
}
Logs:

arduino
Copy code
FFmpeg network initialized
Audio line opened and started
RTSP server started
Additional Information:

This issue occurs even after ensuring FFmpeg network initialization.
The same issue is reproducible on multiple machines with the same configuration.
Screenshots/Video:
(Attach any relevant screenshots or a video demonstrating the issue, if possible.)

Submit the Issue:
After filling out the template, click on the "Submit new issue" button.
Conclusion
By providing a detailed bug report with a clear description, steps to reproduce, environment details, and additional information, you can help the maintainers of the project to understand and address the issue more efficiently.

[saudet]

Please try to set a timeout value