Foreword If you need to understand the basic knowledge of m3u8, you can read the author’s previous articles at the link below. https://www.52pojie.cn/thread-1686788-1-1.html Preliminary analysis Target site: aHR0cHM6Ly93d3cuOTJneXcuY29tL3Nob3J0VmlkZW8vYWxidW0vMjA1P3ZpZGVvSWQ9NDY4NQ== Open the browser, press F12 Developer Tools, and then paste the link into the page. Click the Network menu bar above (Here you can monitor network requests […]
Tag: streaming
[Streaming Media Server] SRS4.0 RTMP to WebRTC ICE interaction analysis
Introduction ICE stands for Interactive Connectivity Establishment: Interactive connectivity establishment method. ICE is implemented according to the recommendations of RFC5245 and is a set of protocols based on the offer/answer mode to solve NAT traversal. It comprehensively utilizes existing STUN, TURN and other protocols to establish sessions in a more efficient way. ICE introduction 1. […]
[Apache Flink] Various application scenarios of streaming analysis
Article directory 0. Preface 1. Evolution of data processing architecture 2. Traditional data processing architecture 3. Transaction processing 4. Analytical processing Traditional data warehouse architecture for data analysis Stateful stream processing 5. Event-driven applications What is an event-driven application? 6. Data pipeline What is a data pipeline? How does Flink support data pipeline applications? Typical […]
Big Data-Storm Streaming Framework (5)—DRPC
DRPC Concept The idea behind Distributed RPC (DRPC) is to use Storm to compute really powerful functions in parallel on the fly. The Storm topology receives a stream of function parameters as input and sends an output stream of results for each function call. DRPC is not a feature of Storm, as it is based […]
Powerful streaming text editor sed
Foreword Recently, I was writing an upgrade script for a project, and found that I had forgotten all the shell commands I had learned before. After much stumbling, I finally finished writing the script. Here is a brief summary of the use of the text editor sed. If there are any mistakes, please criticize and […]
Big data-Storm streaming framework (4)—storm fault tolerance mechanism
1. Cluster node downtime Nimbus Server Hardware Single point of failure? HA can be built using jStorm to build nimbus HA Nimbus information is stored in ZooKeeper. As long as there is no problem downstream (the process exits), there will be no problem when Nimbus exits. If nimbus is down, jobs cannot be submitted. Non-Nimbus […]
SparkStreamingExample Demonstration
Foreword 1. Environment preparation Start Zookeeper and Kafka cluster Import dependencies: <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.12</artifactId> <version>3.2.4</version> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-streaming_2.12</artifactId> <version>3.2.4</version> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-streaming-kafka-0-10_2.12</artifactId> <version>3.2.4</version> </dependency> <dependency> <groupId>mysql</groupId> <artifactId>mysql-connector-java</artifactId> <version>8.0.30</version> </dependency> <dependency> <groupId>com.alibaba</groupId> <artifactId>druid</artifactId> <version>1.1.10</version> </dependency> <dependency> <groupId>com.fasterxml.jackson.core</groupId> <artifactId>jackson-core</artifactId> <version>2.14.2</version> </dependency> 2. Simulated production data Continuously produce random data through loops and use Kafka to […]
Big data-Storm streaming framework (2)-wordcount case
1. Write wordcount case 1. Create a new java project 2. Add storm jar package All jar packages in the lib directory in the storm software package 3. Write java classes WordCountTopology.java package com.bjsxt.storm.wc; import backtype.storm.Config; import backtype.storm.LocalCluster; import backtype.storm.generated.StormTopology; import backtype.storm.topology.TopologyBuilder; import backtype.storm.tuple.Fields; import backtype.storm.utils.Utils; public class WordCountTopology { public static void main(String[] args) […]
SparkSpark Streaming
1. Basic data source 1.1, File stream Run under spark Shell: [lyh@hadoop102 spark-yarn-3.2.4]$ spark-shell Setting default log level to “WARN”. To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 2022-09-08 08:56:21,875 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable Spark context Web UI available at http://hadoop102:4040 Spark […]
Add an interface to digital human generation, build WEBUI based on ER-NeRF/RAD-NeRF/AD-NeRF, Gradio framework, use HLS streaming media to achieve reasoning and playback – Part 1: Real-time output of server console logs in WEBUI
Foreword There are currently many digital human implementation technologies. I use ER-NeRF here. You can see its introduction here: ICCV 2023 | ER-NeRF: Efficient area-aware neural radiation field for synthesizing high-fidelity Talking Portrait-https://zhuanlan .zhihu.com/p/644520609 ER-NeRF project address: https://github.com/Fictionarry/ER-NeRF ER-NeRF, RAD-NeRF, they all inherit from AD-NeRF and have a GUI interface based on dearpygui But unfortunately, […]