Dives into BERT word embeddings with step by step implementation details using PyTorch

Image Source: https://www.greatcontent.com/google-bert/

In 2018, the Google AI team made a revolutionary change in the field of Natural Language Processing ( NLP) by introducing Bidirectional Encoder Representations from Transformers (BERT). Due to its highly pragmatic approach, and higher performance, BERT is highlighted for achieving state-of-the-art performance in many NLP tasks

In this blog, we’ll be looking at word embeddings and see how BERT can be used with word-embedding strategies to feed as input features for other models built for custom tasks to perform the state of art results. …


Single sign-on (SSO) allows a user to sign on with one set of credentials and gain access to multiple applications and services. SSO improves safety and offers clients, staff and associates with a better user experience by decreasing the number of necessary accounts / passwords and offering easier access to all the applications and services they need.

What about Single Logout(SLO)? After all, authentication(SSO) is only the first half of the story.

With single sign-on (SSO), you only need to log in once, and can then access several websites without additional login prompts. so it’s easy for them to be…


Each type of authentication protocol supported by WSO2 Identity Server is handled by a protocol specific inbound authenticator and Identity Server has endpoints for each type of request. Examples- saml endpoint: /samlsso , Oauth endpoint: /oauth, etc.

All authentication requests are received by the servlets in the relevant endpoint hosted. As an example, SAMLSSOProvider servlet receives and handles the SAML requests. Like that, for every protocol, there is a specific servlet to receive and handle the requests.

The Ordinary Flow of Authentication Request Handling

Each servlet will receive the relevant authentication requests and the request processor validates the request and then builds a common object model understood…


Identity federation applies Single Sign On at a much wider scale: ranging from cross-organization to Internet scale. Are you having a clear idea of Single-Sign-On(SSO)?. If No, please go through this blog Single sign on with SAML to make clear on SSO. This blog will explain the identity federation, federation authentication flow and the difference between identity federation and single- sign-on(SSO).

The key to federated identity is trust. The system that holds your information(identity provider) and the system that is requesting your information(Service provider) must trust each other. Let’s see some definitions and the federation authentication flow after understanding them.

Introduction to Identity federation


There was a time when the users had to create user accounts for every application and remember every login credentials. A user might have to log in to five or even twenty separate apps a day. It’s difficult for many people to remember more than three pairs of username / passwords. To work around this difficulty, some individuals use the same login credentials for all the applications they need access to. But if a malicious person acquires these credentials, he might gain access to multiple apps.

That’s why the idea of SSO or Single Sign-On became more popular in enterprise…


Organizations around the world must ensure employees, customers and business partners all have appropriate, secure access to information and technology resources. Identity and access management solutions overcome the challenges of security of enterprise IT.

Before moving to heavy concepts on the security of IT systems, let me explain the foundation of secure access to the IT resources, Identity and Access Management(IAM) by dividing it into some questions.

What is identity??
Identity is a factor that can be used to recognize a person or a thing. We can use the name as the identity of someone. …

Isanka Rajapaksha

Software Engineer @ WSO2 | CSE @ University of Moratuwa

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store