StreaMe

StreaMe - Media Streaming Platform

StreaMe is a powerful and scalable media streaming platform designed to handle high traffic and provide seamless content delivery. It employs microservices architecture to enhance performance, user management, and personalized recommendations. This README file provides an overview of StreaMe and guides you through the installation, configuration, and usage of the platform.

Table of Contents

Features

StreaMe offers the following key features:

  1. Video-on-Demand Streaming: Users can access a vast library of on-demand videos, movies, and TV shows, and stream them seamlessly.
  2. Live Streaming: StreaMe supports live streaming of events, concerts, conferences, and more, providing real-time access to users.
  3. Music Streaming: Users can enjoy a wide range of music tracks, create playlists, and explore personalized recommendations based on their preferences.
  4. Microservices Architecture: StreaMe is built using microservices to enable scalability, fault tolerance, and efficient resource utilization.
  5. High Traffic Handling: The platform is designed to handle high volumes of traffic efficiently, ensuring a smooth streaming experience for users.
  6. Content Delivery: StreaMe optimizes content delivery through caching, CDN integration, and load balancing techniques, reducing latency and improving performance.
  7. User Management: StreaMe provides robust user management features, including authentication, authorization, user profiles, and preferences.
  8. Personalized Recommendations: Leveraging machine learning algorithms, StreaMe offers personalized content recommendations to enhance user engagement and satisfaction.

Prerequisites

Before installing StreaMe, ensure you have the following prerequisites:

Installation

Follow these steps to install StreaMe:

  1. Clone the StreaMe repository from GitHub:
    git clone https://github.com/your-username/StreaMe.git
    
  2. Navigate to the project directory:
    cd StreaMe
    
  3. Install the necessary dependencies:
    npm install
    
  4. Build the Docker containers:
    docker-compose build
    
  5. Start the Docker containers:
    docker-compose up -d
    

Congratulations! You have successfully installed StreaMe.

Configuration

StreaMe requires some configuration to function correctly. Follow these steps to configure the platform:

  1. Create a configuration file based on the provided example:
    cp .env.example .env
    
  2. Open the .env file in a text editor and set the required configuration variables:
    • DATABASE_URL: The URL of the database server.
    • REDIS_URL: The URL of the Redis server for caching.
    • CDN_URL: The URL of the Content Delivery Network.
    • JWT_SECRET: The secret key for JSON Web Tokens (JWT) used in authentication.
    • ... (Other configuration variables as needed)

Save the changes to the .env file.

Usage

To start using StreaMe, follow these steps:

  1. Ensure the Docker containers are running:
    docker-compose up -d
    
  2. Access StreaMe by opening a web browser and entering the URL:
    http://localhost:8080
    

You can now explore the media streaming features provided by StreaMe. Sign up, log in, and start enjoying on-demand videos, live streams, and music tracks. You will also benefit from personalized recommendations based on your preferences.

Contributing

We welcome contributions to StreaMe! To contribute, follow these steps:

  1. Fork the StreaMe repository on GitHub.
  2. Create a new branch for your feature or bug fix:
    git checkout -b my-feature
    
  3. Make the necessary changes and commit them:
    git commit -am 'Add new feature'
    
  4. Push your branch to your forked repository:
    git push origin my-feature
    
  5. Create a pull request on the main StreaMe repository to submit your changes.

Thank you for contributing to StreaMe!

License

StreaMe is licensed under the MIT License. You can find the full license text in the LICENSE file.

Certainly! Here are some additional sections you can add to the README file for StreaMe:

Deployment

To deploy StreaMe in a production environment, follow these steps:

  1. Choose a cloud provider or hosting service that supports Docker and container orchestration (e.g., Kubernetes).
  2. Set up the necessary infrastructure, including virtual machines, load balancers, and a database server.
  3. Configure the environment variables in your production environment according to the .env file.
  4. Build and push the Docker images to a container registry accessible by your deployment environment.
  5. Use the container orchestration tool to deploy StreaMe as a set of microservices, ensuring scalability and fault tolerance.
  6. Set up monitoring and logging for your deployment to gain insights into performance and troubleshoot issues.

API Documentation

StreaMe provides a comprehensive API for integrating with external services or building custom clients. The API documentation is available at API Documentation.

The documentation includes detailed information about the available endpoints, request and response formats, authentication requirements, and example use cases. It serves as a valuable resource for developers looking to extend or integrate StreaMe with other systems.

Testing

StreaMe includes a suite of tests to ensure the reliability and functionality of the platform. To run the tests, follow these steps:

  1. Ensure the development dependencies are installed:
    npm install --dev
    
  2. Run the test suite:
    npm test
    

The test suite will execute various test cases, including unit tests and integration tests, to validate different components of StreaMe. It’s recommended to run the tests before making any changes to the codebase or deploying the platform in a production environment.

Troubleshooting

If you encounter any issues while using StreaMe, consider the following steps for troubleshooting:

  1. Check the logs of the individual microservices to identify any error messages or warnings.
  2. Verify that the required services (database, Redis, CDN) are running and accessible.
  3. Ensure that the environment variables in the .env file are correctly configured.
  4. Consult the StreaMe community forum or support channels for assistance.
  5. If the issue persists, create a detailed bug report, including steps to reproduce the problem, and submit it to the project’s issue tracker on GitHub.

Roadmap

The StreaMe project has an exciting roadmap for future development. Some planned features and enhancements include:

Stay tuned for updates as we continue to enhance StreaMe!

Acknowledgments

We would like to acknowledge the following open-source projects and libraries that have been instrumental in building StreaMe:

We are grateful to the contributors of these projects for their invaluable work.

Contact

For any inquiries, feedback, or support, please contact our team at support@streme.com. We are always happy to assist you!

Project Structure

Node is required for generation and recommended for development. package.json is always generated for a better development experience with prettier, commit hooks, scripts and so on.

In the project root, JHipster generates configuration files for tools like git, prettier, eslint, husky, and others that are well known and you can find references in the web.

/src/* structure follows default Java structure.

Development

Before you can build this project, you must install and configure the following dependencies on your machine:

  1. Node.js: We use Node to run a development web server and build the project. Depending on your system, you can install Node either from source or as a pre-packaged bundle.

After installing Node, you should be able to run the following command to install development tools. You will only need to run this command when dependencies change in package.json.

npm install

We use npm scripts and Angular CLI with Webpack as our build system.

Run the following commands in two separate terminals to create a blissful development experience where your browser auto-refreshes when files change on your hard drive.

./mvnw
npm start

Npm is also used to manage CSS and JavaScript dependencies used in this application. You can upgrade dependencies by specifying a newer version in package.json. You can also run npm update and npm install to manage dependencies. Add the help flag on any command to see how you can use it. For example, npm help update.

The npm run command will list all of the scripts available to run for this project.

PWA Support

JHipster ships with PWA (Progressive Web App) support, and it’s turned off by default. One of the main components of a PWA is a service worker.

The service worker initialization code is disabled by default. To enable it, uncomment the following code in src/main/webapp/app/app.module.ts:

ServiceWorkerModule.register('ngsw-worker.js', { enabled: false }),

Managing dependencies

For example, to add Leaflet library as a runtime dependency of your application, you would run following command:

npm install --save --save-exact leaflet

To benefit from TypeScript type definitions from DefinitelyTyped repository in development, you would run following command:

npm install --save-dev --save-exact @types/leaflet

Then you would import the JS and CSS files specified in library’s installation instructions so that Webpack knows about them: Edit src/main/webapp/app/app.module.ts file:

import 'leaflet/dist/leaflet.js';

Edit src/main/webapp/content/scss/vendor.scss file:

@import 'leaflet/dist/leaflet.css';

Note: There are still a few other things remaining to do for Leaflet that we won’t detail here.

For further instructions on how to develop with JHipster, have a look at Using JHipster in development.

Developing Microfrontend

Microservices doesn’t contain every required backend feature to allow microfrontends to run alone. You must start a pre-built gateway version or from source.

Start gateway from source:

cd gateway
npm run docker:db:up # start database if necessary
npm run docker:others:up # start service discovery and authentication service if necessary
npm run app:start # alias for ./(mvnw|gradlew)

Microfrontend’s build-watch script is configured to watch and compile microfrontend’s sources and synchronizes with gateway’s frontend. Start it using:

cd microfrontend
npm run docker:db:up # start database if necessary
npm run build-watch

It’s possible to run microfrontend’s frontend standalone using:

cd microfrontend
npm run docker:db:up # start database if necessary
npm watch # alias for `npm start` and `npm run backend:start` in parallel

Using Angular CLI

You can also use Angular CLI to generate some custom client code.

For example, the following command:

ng generate component my-component

will generate few files:

create src/main/webapp/app/my-component/my-component.component.html
create src/main/webapp/app/my-component/my-component.component.ts
update src/main/webapp/app/app.module.ts

JHipster Control Center

JHipster Control Center can help you manage and control your application(s). You can start a local control center server (accessible on http://localhost:7419) with:

docker compose -f src/main/docker/jhipster-control-center.yml up

OAuth 2.0 / OpenID Connect

Congratulations! You’ve selected an excellent way to secure your JHipster application. If you’re not sure what OAuth and OpenID Connect (OIDC) are, please see What the Heck is OAuth?

To log in to your app, you’ll need to have Keycloak up and running. The JHipster Team has created a Docker container for you that has the default users and roles. Start Keycloak using the following command.

docker compose -f src/main/docker/keycloak.yml up

The security settings in src/main/resources/config/application.yml are configured for this image.

spring:
  ...
  security:
    oauth2:
      client:
        provider:
          oidc:
            issuer-uri: http://localhost:9080/realms/jhipster
        registration:
          oidc:
            client-id: web_app
            client-secret: web_app
            scope: openid,profile,email

Some of Keycloak configuration is now done in build time and the other part before running the app, here is the list of all build and configuration options.

Before moving to production, please make sure to follow this guide for better security and performance.

Also, you should never use start-dev nor KC_DB=dev-file in production.

When using Kubernetes, importing should be done using init-containers (with a volume when using db=dev-file).

Okta

If you’d like to use Okta instead of Keycloak, it’s pretty quick using the Okta CLI. After you’ve installed it, run:

okta register

Then, in your JHipster app’s directory, run okta apps create and select JHipster. This will set up an Okta app for you, create ROLE_ADMIN and ROLE_USER groups, create a .okta.env file with your Okta settings, and configure a groups claim in your ID token.

Run source .okta.env and start your app with Maven or Gradle. You should be able to sign in with the credentials you registered with.

If you’re on Windows, you should install WSL so the source command will work.

If you’d like to configure things manually through the Okta developer console, see the instructions below.

First, you’ll need to create a free developer account at https://developer.okta.com/signup/. After doing so, you’ll get your own Okta domain, that has a name like https://dev-123456.okta.com.

Modify src/main/resources/config/application.yml to use your Okta settings.

spring:
  ...
  security:
    oauth2:
      client:
        provider:
          oidc:
            issuer-uri: https://{yourOktaDomain}/oauth2/default
        registration:
          oidc:
            client-id: {clientId}
            client-secret: {clientSecret}
security:

Create an OIDC App in Okta to get a {clientId} and {clientSecret}. To do this, log in to your Okta Developer account and navigate to Applications > Add Application. Click Web and click the Next button. Give the app a name you’ll remember, specify http://localhost:8080 as a Base URI, and http://localhost:8080/login/oauth2/code/oidc as a Login Redirect URI. Click Done, then Edit and add http://localhost:8080 as a Logout redirect URI. Copy and paste the client ID and secret into your application.yml file.

Create a ROLE_ADMIN and ROLE_USER group and add users into them. Modify e2e tests to use this account when running integration tests. You’ll need to change credentials in src/test/javascript/e2e/account/account.spec.ts and src/test/javascript/e2e/admin/administration.spec.ts.

Navigate to API > Authorization Servers, click the Authorization Servers tab and edit the default one. Click the Claims tab and Add Claim. Name it “groups”, and include it in the ID Token. Set the value type to “Groups” and set the filter to be a Regex of .*.

After making these changes, you should be good to go! If you have any issues, please post them to Stack Overflow. Make sure to tag your question with “jhipster” and “okta”.

Auth0

If you’d like to use Auth0 instead of Keycloak, follow the configuration steps below:

function (user, context, callback) {
  user.preferred_username = user.email;
  const roles = (context.authorization || {}).roles;

  function prepareCustomClaimKey(claim) {
    return `https://www.jhipster.tech/${claim}`;
  }

  const rolesClaim = prepareCustomClaimKey('roles');

  if (context.idToken) {
    context.idToken[rolesClaim] = roles;
  }

  if (context.accessToken) {
    context.accessToken[rolesClaim] = roles;
  }

  callback(null, user, context);
}
spring:
  ...
  security:
    oauth2:
      client:
        provider:
          oidc:
            # make sure to include the ending slash!
            issuer-uri: https://{your-auth0-domain}/
        registration:
          oidc:
            client-id: {clientId}
            client-secret: {clientSecret}
            scope: openid,profile,email
jhipster:
  ...
  security:
    oauth2:
      audience:
        - https://{your-auth0-domain}/api/v2/

Doing API-First development using openapi-generator-cli

OpenAPI-Generator is configured for this application. You can generate API code from the src/main/resources/swagger/api.yml definition file by running:

./mvnw generate-sources

Then implements the generated delegate classes with @Service classes.

To edit the api.yml definition file, you can use a tool such as Swagger-Editor. Start a local instance of the swagger-editor using docker by running: docker compose -f src/main/docker/swagger-editor.yml up -d. The editor will then be reachable at http://localhost:7742.

Refer to Doing API-First development for more details.

Building for production

Packaging as jar

To build the final jar and optimize the StreaMe application for production, run:

./mvnw -Pprod clean verify

This will concatenate and minify the client CSS and JavaScript files. It will also modify index.html so it references these new files. To ensure everything worked, run:

java -jar target/*.jar

Then navigate to http://localhost:8081 in your browser.

Refer to Using JHipster in production for more details.

Packaging as war

To package your application as a war in order to deploy it to an application server, run:

./mvnw -Pprod,war clean verify

Testing

To launch your application’s tests, run:

./mvnw verify

Client tests

Unit tests are run by Jest. They’re located in src/test/javascript/ and can be run with:

npm test

Other tests

Performance tests are run by Gatling and written in Scala. They’re located in src/test/java/gatling/simulations.

You can execute all Gatling tests with

./mvnw gatling:test

For more information, refer to the Running tests page.

Code quality

Sonar is used to analyse code quality. You can start a local Sonar server (accessible on http://localhost:9001) with:

docker compose -f src/main/docker/sonar.yml up -d

Note: we have turned off forced authentication redirect for UI in src/main/docker/sonar.yml for out of the box experience while trying out SonarQube, for real use cases turn it back on.

You can run a Sonar analysis with using the sonar-scanner or by using the maven plugin.

Then, run a Sonar analysis:

./mvnw -Pprod clean verify sonar:sonar -Dsonar.login=admin -Dsonar.password=admin

If you need to re-run the Sonar phase, please be sure to specify at least the initialize phase since Sonar properties are loaded from the sonar-project.properties file.

./mvnw initialize sonar:sonar -Dsonar.login=admin -Dsonar.password=admin

Additionally, Instead of passing sonar.password and sonar.login as CLI arguments, these parameters can be configured from sonar-project.properties as shown below:

sonar.login=admin
sonar.password=admin

For more information, refer to the Code quality page.

Using Docker to simplify development (optional)

You can use Docker to improve your JHipster development experience. A number of docker-compose configuration are available in the src/main/docker folder to launch required third party services.

For example, to start a postgresql database in a docker container, run:

docker compose -f src/main/docker/postgresql.yml up -d

To stop it and remove the container, run:

docker compose -f src/main/docker/postgresql.yml down

You can also fully dockerize your application and all the services that it depends on. To achieve this, first build a docker image of your app by running:

npm run java:docker

Or build a arm64 docker image when using an arm64 processor os like MacOS with M1 processor family running:

npm run java:docker:arm64

Then run:

docker compose -f src/main/docker/app.yml up -d

When running Docker Desktop on MacOS Big Sur or later, consider enabling experimental Use the new Virtualization framework for better processing performance (disk access performance is worse).

For more information refer to Using Docker and Docker-Compose, this page also contains information on the docker-compose sub-generator (jhipster docker-compose), which is able to generate docker configurations for one or several JHipster applications.

Continuous Integration (optional)

To configure CI for your project, run the ci-cd sub-generator (jhipster ci-cd), this will let you generate configuration files for a number of Continuous Integration systems. Consult the Setting up Continuous Integration page for more information.