Monday, 6 March 2023

List of freelancing work

In case any one want below freelancing work. contact me on - whatsapp link

VM services:

AWS: create

/maintain

/modify the VMs

Azure: create

/maintain

/modify the VMs

SAP BASIS:

1.User administration in ABAP server/ CUA configuration /EULA support.

2.client administration - 1. Local 2. export & import 3. Remote.

2.IDES installation.

3.SAP ABAP server installations.

4.System export and import - (on premise to cloud).

5.SUM tool upgrades.

6. SUM with DMO

7. SYSTEM conversion from ECC to S/4 HANA.
8.Kernel upgrades.

9. SAP support portal administration.

SAP HANA:

1.Provide Cloud infra for SAP HANA servers.
2.SAP HANA Installations.
3.SAP HANA upgrades.
4.SAP HANA Mini checks.
5.HADR configuration / monitoring.

Video classes

For all the video class, please contact me on - whatsapp link

1. Udemy - AWS Certified Solutions Architect - Associate [Latest Exam]: - RS 99 only

index of course: Index
2.

Udemy - AWS Certified Solutions Architect - Associate [Latest Exam]

1. Course Introduction

1. Introduction

2. Recommended Study Plan for best results & Video Speed Control

3. Getting Organized & Summary PDF Download

3.1 Summary Final AWS CSAA Review Notes v1.0 FEB 2020

2. Introduction to Cloud Computing and AWS Global Infrastructure

1. On Premise Data Center , What is Cloud Computing

2. Cloud Computing Offerings - Public, Private and Hybrid Cloud

3. AWS as the Public Cloud IaaS Leader

4. AWS Global Infrastructure - Regions and Availability Zones

5. Architect Profession - Info you need to know

3. Getting Started with AWS - Free Tier Account Setup & AWS IAM Foundation

1. AWS Identity and Access Management 101

2. Hands on Lab - Creating Users and Account Password Policy

3. Hands on Lab - Protecting the Root user using Multi Factor Authentication

4. AWS Free Tier - Know what you are getting for free with your new account

5. Hands on Lab - AWS Billing Alerts and Cost Budgets

4. AWS Servcies Foundation - Introduction to EC2, EBS, IAM, S3

1. Elastic Compute Cloud (EC2) Foundation

2. Hands On Lab - Create your first EC2 instance

5. Core Knowledge - VPC,Sec Group,N ACL,Elastic IP,NAT,VPN,VPC Peering& D. Connect

1. Core Knowledge - VPC introduction

2. Core Knowledge - VPC Components - Implied Router and Route Tables

3. Core Knowledge -VPC Components - IP Addressing - Internet Gateway - Subnet Types

4. DEMO - VPC Overview Lab # 1

5. DEMO - VPC Overview Lab # 2

6. Core Knowledge - VPC Components - VPC Types and Introduction to Security Groups

7. DEMO VPC Lab # 3 - Creating A Custom VPC

8. DEMO - VPC Lab # 4 - Security Groups

9. Core Knowledge - VPC Components - Security Groups Mastery

10. Core Knowledge - VPC Components - Network Access Control Lists (N ACLs)

11. DEMO VPC Lab # 5 - Network Access Control Lists (NACLs)

12. Core Knowledge - VPC - Network ACLs and Security Groups

13. Core Knowledge - VPC - Network ACLs vs. Security Groups

14. Core Knowledge - VPC Security Scenarios - Applying Security Group and N ACLs

15. Core Knowledge - VPC - Network Address Translation - NAT

16. Core Knowledge - VPC Peering

17. DEMO - VPC Lab # 7 - Working with VPC Peering Across AccountsRegions

18. Core Knowledge - Transit Gateway

19. Core Knowledge - VPC Virtual Private Networks (VPN)

20. Core Knowledge - VPC Direct Connect

21. Core Knowledge - Direct Connect Routing and Link Aggregation Groups (LAGs)

22. Hybrid Connectivity Use Cases Scenarios

23. Core Knowledge - AWS Direct Connect Gateway

24. Core Knowledge - AWS Direct Connect Limits

25. AWS VPC - VPC Endpoints - Gateway Endpoint

26. AWS VPC - Hands On Lab - VPC Gateway Endpoint

27. AWS VPC - VPC Interface Endpoint

28. Hands On Labs - VPC Inteface Endpoints

29. Egress Only Internet Gateway (for IPv6)

30. Hands On Labs - Egress-only Internet Gateway

31. Core Knowledge - VPC Flow log and DHCP Option Sets

32. Hands On Labs - VPC Flowlogs

33. VPC Quiz 1

34. VPC Quiz 2

35. VPC Quiz 3

36. VPC Quiz 4

37. VPC Quiz 5

38. VPC Quiz 6

6. Core Knowledge - Master VPC (& its Components) Scenario-based Practice Questions

1. Core Knowledge - AWS VPC Set of Questions #1

2. Core Knowledge - AWS VPC Set of Questions #2

3. Core Knowledge - AWS VPC Set of Questions # 3

4. Core Knowledge - AWS VPC Set of Questions #4

5. Core Knowledge - AWS VPC Set of Questions #5

6. Core Knowledge - AWS VPC Set of Questions # 6

7. Core Knowledge - AWS VPC Set of Questions #8

8. Core Knowledge - AWS VPC Set of Questions #9

9. Core Knowledge - AWS VPC Set of Questions #10

10. Core Knowledge - AWS VPC Set of Questions # 11

11. Core Knowledge - AWS VPC Set of Questions #12

12. Core Knowledge - AWS VPC Set of Questions #13

13. Core Knowledge - AWS VPC Set of Questions #15

7. Core Knowledge - Master Elastic Compute Cloud (EC2) Exam Required Knowledge

1. Core Knowledge - Elastic Block Store Types

2. DEMO - EC2 LAB - Creating an EC2 instance - Part 1

3. DEMO - EC2 LAB - Creating an EC2 instance - Part 2

4. DEMO - EC2 LAB - Creating an EC2 instance - Part 3

5. Hands On Labs - EC2 LAB - Encrypting the Root Volume of an EC2 instance

6. Hands On Labs - LinuxMac users - SSH to an EC2 instance

7. Hands On Labs - Windows PC - SSH to A linux EC2 instance Using Putty

8. Hands On Labs - EC2 Instance States

9. Hands On Labs - Instance Store-backed EC2 instance launch

10. EC2 Enhanced Networking and Placement Groups

11. EC2 Placement Groups

12. EC2 Status Checks and Monitoring

13. EC2 Instance States

14. EC2 Instance Termination and Termination Protection

15. EC2 Instance Metadata and User Data

16. Hands On Labs - EC2 Instance User Data

17. Hands on Labs - EC2 instance metadata

18. Migration tofrom AWS EC2 & VM ImportExport

19. Bastion Hosts

20. EC2 Instance Launch Modes (Purchase Options) - Reserved & Scheduled Instances

21. EC2 Instance Launch Modes (Purchase Options) Part 2

22. VPC and EC2 Instance Tenancy Attribute

23. Elastic Compute Cloud - Elastic Network Interfaces (ENIs)

24. Elastic Network Interface (ENI) - IP Addressing

25. NAT instance SourceDestination Check

26. Public IPv4 address auto assignment

27. DEMO - TCPIP Packet Walkthrough - Deep Dive

28. DEMO LAB - EC2 - VPC Combined Project Lab - Part 1

29. DEMO LAB - EC2 - VPC Combined Project Lab - Part 2

30. DEMO LAB - EC2 - VPC Combined Project Lab - Part 3

31. DEMO LAB - EC2 - VPC Combined Project Lab - Part 4

32. DEMO LAB - EC2 - VPC Combined Project Lab - Part 5

33. DEMO - EC2 - NAT Instance Project - Part # 1

34. DEMO - EC2 Labs - NAT Instance Project - Part # 2

35. DEMO - EC2 Labs - NAT Instance Project & NAT Gateway - Part # 3

36. Troubleshooting EC2

37. EC2 Quiz 1 - 10 Questions

38. EC2 Quiz 2 - 10 Questions

39. EC2 Quiz 3 - 12 Questions

8. Core Knowledge - Master AWS EC2 - Exam Scenario-based Questions

1. Core Knowledge - EC2 Exam Scenario-based Set of Questions #1

2. Core Knowledge - EC2 Exam Scenario-based Set of Questions #2

3. Core Knowledge - EC2 Exam Scenario-based Set of Questions # 3

4. Core Knowledge - EC2 Exam Scenario-based Set of Questions #4

5. Core Knowledge - EC2 Exam Scenario-based Set of Questions #5

6. Core Knowledge - AWS EC2 Exam Scenario-based Set of Questions #6

7. Core Knowledge - AWS EC2 Exam Scenario-based Set of Questions #7

8. Core Knowledge - AWS EC2 Exam Scenario-based Set of Questions #8

9. Core Knowledge - AWS EC2 Exam Scenario-based Set of Questions #9

10. Core Knowledge - AWS EC2 Exam Scenario-based Set of Questions #10

11. Core Knowledge - AWS EC2 Exam Scenario-based Set of Questions #11

12. Core Knowledge - AWS EC2 Exam Scenario-based Set of Questions #12

13. Core Knowledge - AWS EC2 Exam Scenario-based Set of Questions #13

9. Introduction to Encryption and AWS KMS

1. Introduction to Encryption and Cloud HSM

2. AWS Key Management Service (KMS) - Introduction

3. AWS KMS - Customer Master Keys (CMK)

10. Core Knowledge - Master AWS's Elastic Block Store (EBS) Exam Required Knowledge

1. EBS - Block Store Types and IOPS Performance

2. EBS Snapshots

3. EBS Snapshots - 2

4. Hands On Lab - EBS Volumes and Snapshots

5. EBS Encryption 1

6. EBS Encryption 2 - Changing the Encryption state of an EBS volume

7. Hands On Lab - Root EBS Volume Encryption

8. EBS - Sharing EBS Snapshots

9. EBS - Copying EBS snapshots

10. Hands On Lab - EBS Encryption and Sharing Snapshots

11. EBS - Creating and Registering AMIs from Block Store Volumes

12. EBS - Creating AMIs from EBS-Backed EC2 Instances

13. Hands On Labs - EBS - Creating and Sharing AMIs

14. Hands On Labs - EBS - Creating and Sharing AMIs - ENcryption Key permissions

15. EBS Redundant Array of Independent Disks (RAID) and EBS volumes

16. EBS Quiz 1 - 12 Questions

17. EBS Quiz 2 - 12 Questions

18. EBS Quiz 3 - 10 Questions

11. Core Knowledge - Master AWS EBS - Exam Scenario-based Question

1. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions #1

2. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions #2

3. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions #3

4. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions #4

5. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions #5

6. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions #6

7. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions # 7

8. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions #8

9. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions #9

10. Core Knowledge - AWS EBS Exam Scenario-based Set of Questions #10

12. Core Knowledge - Master Elastic Load Balancer (ELB) Exam Required Knowledge

1. Core Knowledge - Elastic Load Balancer - Introduction

2. Core Knowledge - Elastic Load Balancer - How it works

3. Core Knowledge - How ELB works - Continued

4. Core Knowledge - How ELB works - Again !

5. Core Knowledge - ELB health checks

6. Core Knowledge - ELB Cross Zone Load Balancing

7. Core Knowledge - ELB Positioning - Internet-facing vs Internal ELB19. ELB Connection Draining

8. Core Knowledge - Refresher for TCP IP Packet flow

9. Core Knowledge - ELB - Security Group

10. Core Knowledge - ELB - Network ACLs

11. Core Knowledge - ELB - Layer 4 TCPSSL Listeners

12. Core Knowledge - ELB - Layer 7 HTTPHTTPS Listeners

13. DEMO - ELB Service - Classical Load Balancer Overview and Lab Layout - Part 1

14. DEMO - ELB Service - Classical Load Balancer Overview and Lab Layout - Part 2

15. DEMO - ELB Service - Classical Load Balancer Overview and Lab Layout - Part 3

16. Core Knowledge - ELB & Sticky Sessions (Session Affinity)

17. Core Knowledge - ELB Security policy for SSLHTTPS sessions

18. SSLHTTPS authentication - Client and Server Certificates

19. ELB Connection Draining

20. ELB Monitoring

21. ELB Pre-Warming & Scaling

22. Testing you ELB scaling (or applications servers by ELB)

23. ELB Quiz 1 - 10 Questions

24. ELB Quiz 2 - 10 Questions

25. ELB Quiz 3 - 11 Questions

13. Core Knowledge - Master AWS ELB - Exam Scenario-based Question

1. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #1

2. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #2

3. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #3

4. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions # 4

5. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions # 5

6. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions # 6

7. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions # 7

8. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions # 8

9. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #9

10. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #10

11. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions # 11

12. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #12

13. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #13

14. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #14

15. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions # 15

16. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #16

17. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #17

18. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #18

19. Core Knowledge - AWS ELB Exam Scenario-based Set of Questions #19

14. AWS Auto Scaling - Master Auto Scaling Exam Required Knowledge

1. Auto Scaling Introduction - The problem statement

2. Auto Scaling Components

3. Auto Scaling Features

4. Auto Scaling Availability Zone Rebalance feature

5. AddingDetaching EC2 instances tofrom Auto Scaling Groups

6. Auto Scaling and Elastic Load Balancing Service

7. Auto Scaling health checks

8. Auto Scaling Health Checks - SNS Notifications & Merging Auto Scaling groups

9. Hands On Lab (HOL) - Auto Scaling - Part 1

10. Hands On Lab (HOL) - Auto Scaling - Part 2

11. Auto Scaling policiesplans - Part1 - Scheduled Scaling

12. Auto Scaling policies (plans) -Part2 - On-Demand Simple Scaling

13. Auto Scaling policies (plans) - Part 3 - On-Demand Step Scaling

14. Auto Scaling policies (plans) - Part4 - Target Tracking Scaling

15. Auto Scaling - Monitoring

16. Auto Scaling Quiz 1 - 11 Questions

17. Auto Scaling Quiz 2

15. Core Knowledge - Master Auto Scaling Scenario-based Practice Questions

1. Core Knowledge - AWS Auto Scaling Exam Scenario-based Set of Questions #1

2. Core Knowledge - AWS Auto Scaling Exam Scenario-based Set of Questions # 2

3. Core Knowledge - AWS Auto Scaling Exam Scenario-based Set of Questions #3

4. Core Knowledge - AWS Auto Scaling Exam Scenario-based Set of Questions #4

5. Core Knowledge - AWS Auto Scaling Exam Scenario-based Set of Questions #5

6. Core Knowledge - AWS Auto Scaling Exam Scenario-based Set of Questions #6

7. Core Knowledge - AWS Auto Scaling Exam Scenario-based Set of Questions # 7

16. Introduction to Databases

1. Introduction to Relational Databases

2. Introduction to Non-Relational Databases (No-SQL)

3. Core Knowledge - RDS - Types and Examples of Non-Relational Databases

17. Relational Database Service (RDS)

1. Core Knowledge - RDS - Introduction lecture to the AWS RDS Service

2. Core Knowledge - RDS - Multi-AZ option

3. Core Knowledge - RDS - Subnet Groups

4. Hands On Lab - Creating an RDS instance

5. Core Knowledge - RDS - Automatic Backups

6. Core Knowledge - RDS - Manual Backups (Snapshots)

7. Core Knowledge - RDS - Multi-AZ part II

8. Core Knowledge - RDS instance security and encryption

9. Core Knowledge - RDS - Read Replicas of RDS instances

10. Hands On Labs - RDS Instance Actions, Snapshots and Read Replicas

11. Core Knowledge - RDS - Billing and Reserved DB instances

12. Core Knowledge - RDS - Scaling

13. RDS Quiz 1 - 12 Questions

14. RDS Quiz 2 - 12 Questions

15. RDS Quiz 3 - 11 Questions

18. Amazon Aurora

1. Amazon Aurora - Introduction and Aurora Cluster Architecture

2. Amazon Aurora - End Points

3. Amazon Aurora Features - Autoscaling, Storage and Reliability, High Availability

4. Amazon Aurora - Security, Encryption, Global DB, Aurora with other Services

5. Hands On Labs - Create an Amazon Aurora DB Cluster

6. Amazon Aurora Replication, Automated backup and Snapshots, Backtrack feature

7. Amazon Aurora Serverless

19. Core Knowledge - Master AWS RDS Scenario-based Practice Questions

1. RDS Exam Scenario-based Set of Questions #1

2. RDS Exam Scenario-based Set of Questions # 2

3. RDS Exam Scenario-based Set of Questions #3

4. RDS Exam Scenario-based Set of Questions #4

5. RDS Exam Scenario-based Set of Questions #5

6. RDS Exam Scenario-based Set of Questions #6

7. Core Knowledge - AWS RDS Exam Scenario-based Set of Questions #7

20. AWS Auditing, Monitoring, and Notification Services

1. Core Knowledge - AWS Simple Notification Service (SNS)

2. AWS Simple Notification Service - Reliability & Security

3. Hands On Labs - Simple Notification Service (SNS)

4. Introduction to AWS CloudTrail

5. CloudTrtail Log File Integrity Validation

6. Amazon CloudWatch - Introduction

7. CloudWatch - How it works, Cloud Watch Concepts

8. Amazon CloudWatch Alarms

9. Hands On Labs - CloudWatch Alarms

10. CloudWatch Logs - Introduction and Concepts

11. CloudWatch Logs Insights, CW and EC2, CloudTrail, S3 and ElasticSearch

12. Hands On Labs - CloudWatch Logs with VPC FlowLogs and CloudWatch Alarms

13. AWS CloudWatch Logs - CW Agent, Real Time Processing, and Cross Account Logging

14. CloudWatch Events

15. Hands On Labs - CloudWatch Events

21. Core Knowledge - Master Simple Storage Service (S3) Exam Required Knowledge

1. Amazon S3 - Introduction to Object Storage

2. Amazon S3 - Data Consistency models in distributed storage systems

3. Amazon S3 - AWS S3 Buckets - 1

4. Amazon S3 - Objects

5. Amazon S3 - Buckets - 2

6. Hands On Labs - Creating a S3 bucket and uploading Objects

7. Amazon S3 - Bucket Versioning and MFA Delete

8. Hands On Labs - S3 Bucket Versioning

9. S3 - Managing Access and Access Policies

10. Amazon S3 Access Policy types

11. Amazon S3 - Understanding Bucket and Object ACLs - Closer Look

12. Amazon S3 - Copying Uploading S3 Objects

13. S3 Storage Classes - Part 1

14. S3 Storage Classes - Part 2

15. Amazon Glacier - Archive Retrieval in Glacier

16. Amazon S3 Bucket LifeCycle Policies

17. Hands On Labs - S3 Lifecycle PoliciesRules

18. Amazon S3 - Server Side Encryption (SSE)

19. Amazon S3 Server Side Encryption - Detailed

20. Hands On Labs - S3 Server Side Encryption

21. Amazon S3 - When to use Access Control Lists with Buckets & Object

22. Amazon S3 - When to use Bucket and User Policies

23. Amazon S3 - Static Website Hosting in an S3 Bucket

24. Hands On Labs - S3 Static Website Hosting

25. Amazon S3 - Pre-Signed URLs

26. Amazon S3 - Cross Region Replication (CRR) 1

27. Amazon S3 - Cross Region Replication 2

28. S3 Same Region Replication - SRR

29. Hands On Labs - S3 - SRR and CRR

30. Amazon S3 - Cross Origin Resource Sharing (CORS)

31. Core Knowledge - S3 - Transfer Acceleration

32. Amazon S3 Performance considerations and best practices

33. Amazon S3 and Glacier SELECT

34. Core Knowledge - S3 - Billing

35. Core Knowledge - S3 - Notification and S3 Monitoring

36. Hands On Labs - Installing AWS CLI on Windows, MacOS, and Linux

37. S3 Quiz 1 - 9 Questions

38. S3 Quiz 2 - 9 Questions

22. Core Knowledge - Master AWS S3 Scenario-based Practice Questions

1. Core Knowledge - AWS S3Glacier Exam Scenario-based Set of Questions #1

2. Core Knowledge - AWS S3Glacier Exam Scenario-based Set of Questions #2

3. Core Knowledge - AWS S3Glacier Exam Scenario-based Set of Questions #3

4. Core Knowledge - AWS S3Glacier Exam Scenario-based Set of Questions #4

23. File System options - EFS and FSx

1. AWS Elastic File System (EFS) - Introduction to the Service and Mount Targets

2. AWS EFS - Use Cases , Use in On Premise Servers , Storage Classes, Pricing

3. Hands On Labs - EFS

4. AWS EFS - Data Encryption, EFS Data backup, EFS and AWS Datasync, Monitoring EFS|

5. AWS FSx for Windows File Server - Introduction, Deployment options & Encryption

6. Amazon FSx - Data Protection, BackupRestore, Access, Monitoring and Security

7. Hands On Labs - Amazon FSx for Windows File Server

8. Amazon FSx for Lustre

9. Amazon EFS vs FSx for Windows vs FSx for Lustre

10. Hands On Labs - Amazon FSx for Lustre

24. Amazon Route 53 - AWS's Domain Name System (DNS) Service

1. Amazon Route 53 - Introduction to DNS System and DNS Hierarchy

2. Amazon Route 53 - Registering Domains with Route 53

3. Amazon Route 53 - Steps to configure ROUTE 53

4. Hands On Labs - Registering a Domain Name with Route 53

5. Amazon Route 53 - Hosted Zones

6. Amazon Route 53 - Working with Hosted Zones

7. Hands On Labs - Creatingtesting the Lab setup and Route53 Simple Routing

8. Amazon Route 53 - Supported DNS Record Types

9. Amazon Route 53 - Alias or No Alias - CNAME vs Alias records

10. Hands On Labs - Route 53 Alias Records

11. Amazon Route 53 - Health Checks

12. Amazon Route 53 - Routing Policies - Failover & Geolocation Routing

13. Hands On Labs - Route 53 Health Checks and Failover Routing

14. Hands On Labs - Route 53 Geolocation (Geo) Routing

15. Amazon Route 53 - Latency and Weighted Routing Policies

16. Hands On Labs - Route 53 Latency Routing

17. Hands On Labs - Route 53 Weighted Routing

18. Hands On Lab - Amazon Route 53 MultiValue Answer

19. Amazon Route 53 Resolver

20. Hands on Labs - Route 53 Resolver

21. Amazon Route 53 - Pricing

22. AWS ROUTE 53 - Quiz 1 - 8 Questions

25. Core Knowledge - AWS CloudFront

1. Content Delivery Networks (CDNs) introduction

2. Amazon CloudFront - Static and Dynamic Content

3. Amazon CloudFront - Introduction

4. Amazon CloudFront Regional Edge Cache

5. Amazon CloudFront Distributions

6. Amazon CloudFront - Origin types

7. Amazon CloudFront - Content Delivery

8. Amazon CloudFront - Alternate Domain Names

9. Amazon CloudFront - Supported HTTP Methods & Serving Private Content

10. Amazon CloudFront - Viewer & Origin Protocol - & Object Invalidation

11. Hands On Labs - Configuring a Cloudfront Web Distribution with a S3 AWS Origin

12. Amazon CloudFront - Field Level Encryption & WAF & GeoRestriction

13. Amazon CloudFront - Video Streaming Access Logs & Cloudtrail Pricing

14. Global Accelerator

15. Hands-On Lab Global Accelerator

16. AWS Cloudfront Quiz # 1 - 4 Questions

26. Messaging and Integration

1. AWS Simple Queue Service (SQS) - Introduction

2. AWS SQS - Polling types and SQS Timers

3. AWS SQS - Reliability, Security, and Encryption

4. Hands On Labs - Simple Queue Service and Integration with SNS

5. AWS SQS - Monitoring, SQS queue names, and Logging

6. Amazon MQ

7. AWS SQS Quiz 1 - 7 Questions

8. AWS SQS Scenario Based Practice Questions Set #1

9. AWS SQS Scenario Based Practice Questions Set #2

27. Amazon Serverless Services

1. Introduction to AWS Lambda

2. AWS Serverless (lambda-based) Applications building blocks

3. AWS Lambda Function Invocation types

4. AWS Lambda Triggers - Event Sources that can Trigger a Lambda Function

5. Hands On Labs - Lambda and S3 as a Trigger

6. AWS Lambda Use Cases

7. AWS Lamda Scaling, Versioning, and Service Limits

8. AWS Lambda - Operatins and Monitoring

9. AWS Lambda@Edge

10. AWS Lambda Quiz 1 - 5 Questions

11. AWS Lambda Scenario Based Questions Set # 1

12. Introduction to AWS API Gateway

13. API Gateway Architecture , API Methods and Resources

14. API Gateway - Scaling - Throttling and Caching

15. API Gateway CORS & API Operations and Monitoring

16. Hands On Labs - API Gateway

17. AWS API Gateway Quiz 1 - 7 Questions

18. AWS API Gateway Scenario Based Practice Questions Set # 1

19. AWS API Gateway Scenario Based Practice Questions Set # 2

20. AWS DynamoDB - Review of NoSQL and Data Types

21. DynamoDB Introduction

22. DynamoDB tables, components, Primary Key

23. DynamoDB Table Throughput

24. Hands On Labs - Creating a DynamoDB SImple Key table and Global Tables

25. DynamoDB - Local and Global Secondary Indexes

26. Hands on Labs - DynamoDB Local and Global Secondar Indexes

26.1 DynamoDB Global Local Secondary Indexes 1

26.2 DynamoDB Global Local Secondary Indexes 2

27. DynamoDB Local, BackupRestore, Point in Time Reovery, and TTL

28. Hands On Labs - DynamoDB Point in Time Recovery, On Demand Backup and TTL

29. DynamoDB Accelerator (DAX)

30. DynamoDB Streams

31. DynamoDB Transactions

32. Amazon Neptune and DocumentDB (With MongoDB compatibility)

33. 7-5) DynamoDB Scalability, Throttling, and Limits

34. DynamoDB Quiz 1 - 11 Questions

35. DynamoDB Scenario Based Practice Questions Set # 1

36. DynamoDB Scenarios Based Practice Questions Set # 2

28. AWS Caching, Big Data, Data Streaming, Analytics, and IoT Services

1. Amazon Elastic Map Reduce - Introduction

2. AWS EMR - Clusters, Nodes, and deployment in an AZ

3. Amazon Elasticache Introduction

4. Amazon ElastiCache - Caching Strategies

5. Amazon Elasticache for Memcached

6. Amazon Elasticache for Redis

7. Amazon ElastiCache Quiz # 1 - 7 Questions

8. Amazon Elasticache Scenario Based Questions set #1

9. Amazon Elasticache Scenario Based Questions set #2

10. Amazon Elasticache Scenario Based Questions set # 3

11. 5-1) AWS Kinesis - Introduction

12. 5-2) AWS Kinesis Data Streams

13. Hands On Labs - Amazon Kinesis Data Streams

13.1 Kinesis lab

14. 5-3) AWS Kinesis Data Firehose

14.1 Kinesis lab

15. Hands On Labs - Kinesis Firehose

16. 5-4) AWS Kinesis Analytics

17. AWS Kinesis Quiz 1

18. 5-5) AWS Kinesis Scenario Based Practice Questions Set # 1

19. 5-6) AWS Kinesis Scenario Based Practice Questions Set # 2

20. 5-7) AWS Kinesis Scenario Based Practice Questions Set # 3

21. 5-8) AWS Kinesis Scenario Based Practice Questions Set # 4

22. 4-1) AWS Redshift - Introduction

23. 4-2) AWS Redshift BackupRestore & Monitoring

24. 4-3) AWS Redshift - High Availability, Data Durability, Scaling and Billing

25. 7-6) DynamoDB integration with RedShift and AWS EMR plus Best Practices

26. AWS Redshift Quiz 1 - 3 Questions

27. 4-4) AWS Redshift Scenario Based Practice Questions Set # 1

29. AWS Services and Strategies for Deployment Management

1. Amazon CloudFormation

2. Amazon Cloudformation Template Components

3. Hands On Labs - Creating a CF Stack, Updating a Stack, and Stack Change Sets

4. AWS OpsWorks - Introduction

5. AWS Opsworks Stacks and Layers

6. AWS OpsWorks Components

7. AWS Elastic BeanStalk - Introduction

8. Elastic BeanStalk - Components and Concepts

30. Amazon Elastic Container Services (ECS)

1. 8-1) AWS EC2 (Elastic) Container Service [ECS] - Why we need it

2. 8-2) AWS ECS - Introduction to Docker

3. 8-3) Introduction to AWS ECS

4. 8-4) AWS ECS Launch Types

5. 8-5) AWS ECS - Task Definitions and Tasks

6. 8-6) AWS ECS and IAM Roles

7. Elastic Kubernetes Service (EKS)

8. AWS ECS Quiz 1 - 5 Questions

9. AWS ECS Scenario Based Practice Questions Set # 1

10. AWS ECS Scenario Based Practice Questions Set # 2

31. Core Knowledge - Application Load Balancer

1. Classic Load Balancer Refresher and Weaknesses

2. Introduction to Application Load Balancer

3. ALB Components explained

4. Hands on Labs - Creating Route Targets and Application Load Balancer

5. ALB Listener Rules

6. ALB Content Routing ( Host and Path based routing)

7. ALB - Containers and Microservices Support

8. ALB and ECS Dynamic Host Port Mapping

9. Hands-On Lab ECS and Application Load Balancer

10. Monitoring the ALB

32. Amazon Network Load Balancer (NLB)

1. Amazon ELB - Network Load Balancing (NLB) - Agenda

2. Quick Amazon ELB Recap

3. Amazon NLB - L2.5 Features and How it Works

4. Amazon NLB - Features and How it Works (Cont.)

5. Amazon NLB - Supported Target Types

6. Amazon NLB - Source IP Address Preservation

7. Amazon NLB - Proxy Protocol - Health Checks - Monitoring

8. Amazon NLB - Troubleshooting Some Common Problems

33. AWS Identity and Access Management ( IAM ) and AWS Directory Services

1. AWS Directory Services - Introduction

2. AWS Services - AWS Microsoft Active Directory - 1

3. AWS Directory Service - AWS Microsoft AD - 2

4. AWS Directory Service - AWS Simple AD

5. AWS Services - AWS Directory Services - AWS Connector

6. AWS Directory Service Quiz # 1 - 5 Questions

7. AWS Directory Service - Scenario Based Questions Set # 1

8. AWS Directory Service - Scenario Based Questions Set # 2

9. AWS Identity and Access Management (IAM) - Introduction

10. IAM - Features

11. IAM Elements

12. IAM Elements (Actions and Resources)

13. IAM & Identity Federation

14. IAM - Identities - Groups , Roles and Temporary Credentials

15. IAM Identity-based and Resource-based policies

16. IAM Users deep dive

17. IAM User Credentials detailed

18. IAM Roles

19. IAM Service Roles

20. IAM Role Delegation

21. AWS Cross-Account Access

22. Cross Account Access with External ID

23. IAM Users and Roles - When to use what

24. IAM Logging using AWS CloudTrail

25. IAM Best Practices

26. AWS IAM Quiz 1 - 12 Questions

27. AWS IAM Scenario Based Practice Questions Set # 1

28. AWS IAM Scenario Based Practice Questions Set # 2

29. Security Token Service (STS) - Introduction

30. WebID Federation and STS Credentials

31. Using STS Security Credentials - WebID Federation example

32. Web Identity Federation using STS

33. Identity Federation with SAML 2.0 - AWS API Access

34. Identity Federation with SAML 2.0 (Console Access

35. AWS Single Sign-On (SSO)

36. AWS Web Application Firewall (WAF)

37. Hands-On Lab AWS WAF

38. AWS Secure Token Service (STS) Quiz 1 - 5 Questions

39. AWS STSID Federation Scenario Based Practice Questions Set # 1

34. Amazon Data Migration Services and Hybrid Cloud

1. AWS Snowball

2. AWS Snowball, SnowBall Edge, Snowmobile

3. Hands On Labs - AWS Snowball Console Walkthrough

4. AWS Storage Gateway - Snowball - VM ImportExport

5. Hands On Labs - AWS Storage Gateway console Walkthough

6. AWS DataBase Migration Service (AWS DMS)

7. AWS Database Migration Services - How it works and Schema Conversion Tool (SCT)

8. AWS DMS Components - Replication Instance, Multi AZ, DMS and VPC

9. AWS Server Migration Service (SMS)

35. Misc Services

1. AWS Organizations

2. AWS Organizations - Components

3. AWS Organizations - Features

4. Hands-On Lab AWS Organizations and Service Control Policies

5. AWS Glue - What is it, how it works, and its components

6. AWS Systems Manager

7. AWS Parameter Store

8. AWS Secrets Manager

9. Hands-On Lab Secrets Manager and Parameter Store

10. Amazon Athena

11. Hands On Labs - Amazon Athena

11.1 Athena DLL file

12. AWS Service Catalog

13. AWS Config

14. AWS Batch

15. Amazon X-Ray

16. AWS Resource Access Manager (AWS RAM)

17. Amazon SWF - Introduction , Benefits and Concepts

18. AWS SWF - Concepts , Task Types and Endpoints

19. AWS Step Functions

20. Amazon GuardDuty

21. Amazon Inspector

22. Amazon Macie

23. Amazon WorkSpaces

24. Amazon WorkDocs

25. AppSync

26. Elastic Transcoder

27. Elasticsearch

36. Wrap Up

1. Exam Blueprint and AWS website tour (certification and documentation knowledge)

2. Requesting 30 Minutes additional Exam time for Non Native English Speakers

Sunday, 11 December 2022

SAP HANA memory consumption

1. Resident memory:

Physical memory: the actual RAM of the system attached on the motherboard.

To check the total physical number in SAP HANA:
----------------------------------------------------------------------------------------------------------------

DO BEGIN

DECLARE V_INSTANCE_NAME varchar(20);

select t1.VALUE into V_INSTANCE_NAME from "SYS"."M_SYSTEM_OVERVIEW" t1

where UPPER(t1.NAME) = 'INSTANCE ID';

select V_INSTANCE_NAME as Instance_id,

round((FREE_PHYSICAL_MEMORY + USED_PHYSICAL_MEMORY)/1024/1024/1024, 3) as "Total Physical memory resource GB size"

from PUBLIC.M_HOST_RESOURCE_UTILIZATION;

END;

------------------------------------------------------------------------------------------------------

Resident memory: the real physical memory that processes utilize in the current state.

The below query give:

how much resident memory is used by the HANA database.

----------------------------------------------------------------------------------------------------------------

SELECT HOST,

ROUND(USED_PHYSICAL_MEMORY/1024/1024/1024, 2) AS "Resident GB",

ROUND((USED_PHYSICAL_MEMORY + FREE_PHYSICAL_MEMORY)/1024/1024/1024, 2) AS "Physical Memory

GB"

FROM PUBLIC.M_HOST_RESOURCE_UTILIZATION

-------------------------------------------------------------------------------------------------------------------

*resident memory used outside HANA (OS, 3rd party processes) is typically quite small, not exceeding 2 GB.

in case, to check free physical RAM size using current. Just to crosscheck any other process apart from SAP HANA is consuming more RAM.

the below Linux command, need to run at OS level:

--------------------------------------------------------------------------------------------------------------------

FREE_LINUX_MEMORY=`vmstat -s | grep "free memory" | awk '{print $1}'`

RESULT=`echo "scale=3; $FREE_LINUX_MEMORY / 1024 / 1024" | bc -l`

echo "Free physical memoy : $RESULT GB"

-------------------------------------------------------------------------------------------------------------------

* DBACockpit does currently not consider shared memory as part of the resident memory.

Case -2:

2.If processes outside the database are not contributing significantly to memory usage, 2 cases have to be distinguished in general:

1. An 'out of memory' error has already occurred. - https://launchpad.support.sap.com/#/notes/1984422

What is OOM:

The memory requirements of SAP HANA exceed the available memory resources or a configured memory limit. When SAP HANA requires additional memory and is not able to allocate new memory or reclaim memory otherwise, an out-of memory (OOM) dump is generated and the action is terminated.

* By default OOM dump is written once in 24HR.

*you may modify the parameter oom_dump_time_delta .

Major reasons for causing OOM:

* Expensive queries materializing results,

*too many/too large loaded tables,

*too large internal structures/system caches,

*blocked garbage collection by long-running cursors.

* too many sessions, connections, transactions, statements running.

HOW to access OOM file?

1) Go to Administration -> Diagnosis Files;

2) Search for the Key word - OOM.

3) Consider index server file first.

4)Double click on the file.

5) Show Entire File - option need to select.

How to resolve OOM?

* If multiple OOM dump files are generated you should start with analyzing the index server dump file, because in most cases the index server is responsible for the highest memory consumption.

* If you use the Diagnosis Files tab in SAP HANA Studio you have to make sure that the complete file is displayed (“Show Entire File”), otherwise some information can be missing.

The dump file typically contains the following sections that contain useful information for analyzing OOM issues:

[BUILD]        Build information
[THREADS]      Running threads
[STACK_SHORT]  Short call stacks and pending exceptions of all threads
[PROCESS_INFO] Process information
[OS_MEMORY]    Operating system information about memory
[MEMORY_OOM]   Information about current out of memory situation
[STAT]         Statistical data

Key points:
* time stamp of OOM error.

* version number.

* search for the key word - failed to allocate.

* current callstack - is the cause for OOM.

* global_allocation_limit -

* Top allocators

inclusive_size_in use - including of all sub allocators
exclusive size in use - including of only main allocators of the heap memory.

Generally 3 kinds of situations in OOM:

1. GAL is less then required memory - need to Analysis - * if the table is row table, can convert in to column store table.
* Check the size of table.
* Table partition.

* all other possibilities to increase the performance of access the table.

* At last, we can consider to increase the size of RAM.

2.if GAL is 1000GB

memory required - 975GB

failed to allocate - 25GB

* there is high probability to avoid the OOM in the next occurance.
* Can ignore the OOM in this case.

3. IF some cases, even though the size of GAL is more then the size of required memory size.

in this case also, OOM will created -

GAL - 1000GB
failed to allocate - 0GB

Analysis - check all the OOM occurred at the same time.
- in other case, if the above case is not cause. Then due to the case of previous SQL queries are not been removed from the memory.

-----------------------------------------------------------------------------------------------------------------

1. Login into the tenant database where the alert got triggered.

2. Check the pool size on the tenant.

3. Communicate to DBA on the approval for SQL plan cache clearing

4. Execute the below on the tenant after DBA approval :

ALTER SYSTEM CLEAR SQL PLAN CACHE

ALTER SYSTEM CLEAR METADATA CACHE

---------------------------------------------------------------------------------------------------------------

Case 3

2.An 'out of memory' error was not yet triggered, but further investigation on the current memory usage of the database might be required.

1) Go to Administration -> Diagnosis Files;

2) Select "Diagnosis Information -> Collect...";

3) Set the option 'Create and collect one or multiple sets of runtime environment (RTE) dump file(s)';

4) Set the hosts, amount of samples (sets) and frenquency on which the runtime dumps will be recorded;

5) Finish.

More info - 1813020 - How to generate a runtime dump on SAP HANA.

case 4:

Top down approach:

Which HANA process on which host is using most of the memory?

SELECT TOP 3 HOST, PORT, SERVICE_NAME, TOTAL_MEMORY_USED_SIZE

FROM M_SERVICE_MEMORY

ORDER BY TOTAL_MEMORY_USED_SIZE DESC

Case 5:

So far, the sum of used heap and shared memory has been determined. Now, this total has to be split.

Memory that can be accessed by different processes, e.g.:

Specific row store components (tables, catalog, free)
Nameserver topology

SELECT TOP 3 HOST, PORT, SERVICE_NAME, HEAP_MEMORY_USED_SIZE, SHARED_MEMORY_USED_SIZE,

TOTAL_MEMORY_USED_SIZE

FROM M_SERVICE_MEMORY

ORDER BY SHARED_MEMORY_USED_SIZE DESC

CASE 6: Trace file approach The first part of this section lists the local (heap) memory the processes that make up the HANA database are currently using:

[0] PID=34884, SId=42309944, compactors active, alive, process name: hdbnameserver
AB=2220466176b (2.06gb), UA=0b, U=2015851859b (1.87gb), FSL=0b, PAL=487738426982b (454.24gb), TPAL=2220466176b (2.06gb), W=100

[1] PID=35049, SId=42310545, compactors active, alive, process name: hdbpreprocessor
AB=365772800b (348.82mb), UA=0b, U=362430594b (345.64mb), FSL=0b, PAL=487738426982b (454.24gb), TPAL=365772800b (348.82mb), W=100

[3] PID=35094, SId=42310846, compactors active, alive, process name: hdbstatisticsse
AB=17623138051b (16.41gb), UA=0b, U=14624613181b (13.62gb), FSL=268435456b (256mb), PAL=27096579276b (25.23gb), TPAL=17757355779b (16.53gb), W=100

[4] PID=35114, SId=42310947, compactors active, alive, process name: hdbxsengine
AB=2270855168b (2.11gb), UA=0b, U=2136436039b (1.98gb), FSL=0b, PAL=487738426982b (454.24gb), TPAL=2270855168b (2.11gb), W=100

[5] PID=33976, SId=171197412, compactors active, alive, process name: hdbindexserver
AB=240495694077b (223.97gb), UA=0b, U=260528715346b (242.63gb), FSL=0b, PAL=487738426982b (454.24gb), TPAL=270062153728b (251.51gb), W=100

For each process, the allocation limit (PAL),
the amount of memory currently allocated (AB)

used (U)

It might be the case that the request was that large that it was anyway impossible to fulfill it:

[MEMORY_OOM]  Information about current out of memory situation: 
OUT OF MEMORY occurred.
Failed to allocate 2405843009873693952 byte.

A known issue regarding such large request is solved with revision 50. In case this occurs in newer revisions, please contact SAP Support.

CASE 7:

-----------------------------------------------------------------------------------------------------------------------------------

Change the Global Memory Allocation Limit

The SAP HANA database preallocates a pool of memory from the operating system over time, up to a predefined global allocation limit. You can change the default global allocation limit in the global.ini configuration file. SAP HANA One is pre-configured with 60.5 GB of memory in global_allocation_limit.

Prerequisites

You have the system privilege INIFILE ADMIN.

Context

The global_allocation_limit parameter is used to limit the amount of memory that can be used by the database. The value is the maximum allocation limit in MB. A missing entry or a value of 0 results in the system using the default settings. The global allocation limit is calculated by default as follows: 90% of the first 64 GB of available physical memory on the host plus 97% of each further GB. Or, in the case of small physical memory, physical memory minus 1 GB.

Procedure

In the Administration editor, choose the Configuration tab.
The configuration files that contain the configuration information for the system are displayed.
Expand the global.ini configuration file and then the memorymanager section.
In the context menu for the global_allocation_limit parameter, choose Change...
The Change Configuration Value dialog box appears.
Enter a value for the entire system and/or individual hosts.

-----------------------------------------------------------------------------------------------------------------------------

Case 8:

The results of shared memory creation can then be viewed on OS level using the ipcs command.

1. Get the process pid: ps -ef | grep

2. ipcs -p | grep then displays all segments that were created by this particular process:

ipcs -p | grep 4221

86999065 hanadm 4221 4221

87064602 hanadm 4221 4221

87130139 hanadm 4221 4221

87195676 hanadm 4221 4221

87261213 hanadm 4221 4221

87359519 hanadm 4221 4221

88309819 hanadm 4221 4221

88375356 hanadm 4221 4221

88440894 hanadm 4221 4221

3. The size of a particular segment can then be further examined using the command ipcs -m -i <id>

ipcs -m -i 86999065

Shared memory Segment shmid=86999065

uid=60000 gid=100 cuid=60000 cgid=100

mode=01600 access_perms=0600

bytes=8929752 lpid=4221 cpid=4221 nattch=1

att_time=Tue May 14 14:09:13 2013

det_time=Tue May 14 14:09:13 2013

change_time=Tue May 14 14:09:13 2013

The sum of all those shared memory segments is then equivalent to the output of the statement:

SELECT SHARED_MEMORY_ALLOCATED_SIZE FROM M_SERVICE_MEMORY WHERE PROCESS_ID = '4221'

Case 9: Row store reorganization

1813245 - SAP HANA Row Store Reorganization

Reason:

Row store grows by allocating a 64MB memory segments and shrinks by freeing empty segments.A segment is internally divided into fixed-size pages.
When a row store table requires more memory to store records, the table takes a free page from existing segments. If no segment has a free page, a new segment is allocated.

Deleting a large number of records may result in a number of sparse segments. In such a case, row store reorganization can be performed for memory compaction.
The pages in sparse segments are moved to other segments and the resultant empty segments are freed.

When to reorganize the row store

Row store reorganization is recommended, if the allocated row store table size is > 10GB and free page ratio is > 30%.

SELECT HOST, PORT, CASE WHEN (((SUM(FREE_SIZE) / SUM(ALLOCATED_SIZE)) > 0.30) AND SUM(ALLOCATED_SIZE) > TO_DECIMAL(10)*1024*1024*1024) THEN 'TRUE' ELSE 'FALSE' END "Row store Reorganization Recommended", TO_DECIMAL( SUM(FREE_SIZE)*100 / SUM(ALLOCATED_SIZE), 10,2) "Free Space Ratio in %",TO_DECIMAL( SUM(ALLOCATED_SIZE)/1048576, 10, 2) "Allocated Size in MB",TO_DECIMAL( SUM(FREE_SIZE)/1048576, 10, 2) "Free Size in MB" FROM M_RS_MEMORY WHERE ( CATEGORY = 'TABLE' ) and ( ALLOCATED_SIZE > 0 ) GROUP BY HOST, PORT;

in the result of above SQL command:

* Check ROW store Reorganization recommended column.
* Free space ratio column

need to consider.

If the result for Reorganization Recommended is TRUE, then row store memory can be reclaimed after row store reorganization.

How to estimate the amount of reclaimable memory

To estimate the maximum possible amount of memory that can be reclaimed, you can use below command:

SELECT HOST, PORT, FREE_SIZE/1024768 "Estimated Maximum Memory Saving in MB" FROM M_RS_MEMORY WHERE CATEGORY IN ('TABLE')

To below process will work for SAP HANA 2.0 >=SPS04:

Online Row Store Reorganization v2

Connect to the system
Execute Online Row Store Reorganization using commands:

ALTER SYSTEM RECLAIM DATA SPACE

CALL REORGANIZE_ROWSTORE('REORGANIZE')

To monitor the progress, check the check the monitoring view M_JOB_PROGRESS, check the Job Progress Tab in Performance Tab of the HANA Studio, or use the JobProgress in Show Statement Library in Cockpit.
Check the indexserver trace files after row store reorganization is done. The trace of Online Row Store Reorganization is separately managed in indexserver_<hostname>.<port>.row_store_reorg.<sequence>.trc

[000000000000][0] 0000-00-00 00:00:00.000000 i RowStoreReor Executor.cc(00033) : ==== Reorganize started ====
[000000000000][0] 0000-00-00 00:00:00.000000 i RowStoreReor Executor.cc(00241) : Number of target segments: 0
[000000000000][0] 0000-00-00 00:00:00.000000 i RowStoreReor Executor.cc(00242) : Expected memory saving: 000 (MB)
…
[000000000000][0] 0000-00-00 00:00:00.000000 i RowStoreReor Executor.cc(00518) : PostReorg: emptied 0 segments

Check the memory fragmentation status after reorganization using:

CALL REORGANIZE_ROWSTORE('DISPLAY_MEMORY_STATUS')

For offline Row Store Reorganization:

please refer Snote - 1813245

9.1

Indirectly, high memory usage of the row store can cause problems when parameter

client_distribution_mode is set to 'off' in distributed environments. When default value 'statement' is used, the statement is sent to the node where the table is located. With the setting 'off', the statement

might then also be directed to the master node. Since all row store tables are usually located on the

master node and consequently, the row store uses a lot of memory, materializing a large amount of

data on the master node (from a table that is actually located on another node) can then simply be too

much. Therefore, in case of problems with resolving internal and external hostnames, parameter

client_distribution_mode should not be turned off.

9.2: Too many large tables were created as row store tables. The largest tables currently contained in the row store can be retrieved by the following SQL Statement:

SELECT TOP 50 * FROM M_RS_TABLES ORDER BY (ALLOCATED_FIXED_PART_SIZE + ALLOCATED_VARIABLE_PART_SIZE) DESC

It is however important to keep in mind that in many scenarios, switching a table from rowstore to columnstore and vice versa must not be done. This applies to Suite on HANA / BW systems which are delivered with particular settings for different table types. At any case, it makes sense to check whether the system is currently adhering to the recommended configuration or not. SAP note 1659383 contains a list of tables that are supposed to be in the rowstore and a check that is based on this list is part of report RSDU_TABLE_CONSISTENCY. This report also contains a repair option when a deviation is recognized.

CASE: 10 - Heap memory analysis.

* In most cases, the process of interest is the index server, since it usually allocates the greatest share of the available memory.

the below query is used to show inclusive size to exclusive size:

---------------------------------------------------------------------------------------------------------------------------------------------------

SELECT TOP 15 MS.HOST, MS.SERVICE_NAME,MH.CATEGORY, MH.INCLUSIVE_SIZE_IN_USE, MH.EXCLUSIVE_SIZE_IN_USE FROM M_HEAP_MEMORY MH, M_SERVICES MS WHERE MH.PORT = MS.PORT AND MH.HOST = MS.HOST AND MS.SERVICE_NAME = 'indexserver' ORDER BY 4 DESC

----------------------------------------------------------------------------------------------------------------------------------------------------

few case studies:

Pool/parallel/ihm There are cases where this allocator used 90% of the available memory. If such a problem is observed, the system should be upgraded to revision 54 when available. Pool/itab

This allocator is needed for the intermediate result of join operation and translation table used for join operation. This could indicate use of a suboptimal model.

Pool/FemsCompression/CompositeFemsCompressionPool/FemsCompression/CompositeFemsCompression

A known issue is associated with high memory usage that is solved with revision 53. FEMS compression is used in BW systems to keep the size of the dataset that is transferred to the application server as small as possible.

Pool/ValueArray

This is the allocator which keeps the complete resultset in uncompressed form. A known issue has been solved with revision 55 which addresses memory used by this allocator not released after oom situations, thus steadily increasing over time. The details are documented in SAP note 1852425.

Pool/JoinEvaluator/TranslationTable

Translation tables are created for caching join column entries of join engine queries. The number of translation tables that are kept in memory is determined by the the following parameter in indexserver.ini:

[joins]

translator_cache_size = n

The default value is 2000. In order to verify how many translation tables currently exist in the system, the following statement can be used:

select * from sys.M_DEV_JOIN_TRANSLATION_TABLES_ order by TRANSLATION_TABLE_MEMORY_SIZE desc

This statement sums up the memory usage of those tables:

select host, port, transtable_memory from sys.m_dev_joinengine_

In case of excessive memory usage for this allocator, the parameter can be set to 500 as a starting point. Lowering the value can have an impact on query performance though. However, in live systems where this was done, no negative side effects were observed sofar.

Pool/malloc/libhdbcsapi.so

A memory leak was introduced with revision 54 that can lead to a huge growth of this allocator when BW queries containing lots of OR terms instead of IN lists are executed. A possible workaround from application side is the implementation of SAP note 1786777. From HANA side, the problem is solved starting with revision 60 (HANA SP6). See also SAP note 1880274.

For further information on the meaning of HANA Memory allocators and known reasons why they could consume a high amount of memory please refer to question 13. What can I do if a certain heap allocator is unusually large? from the knowledge base article 1999997 - FAQ: SAP HANA Memory.

Case 11 - Memory Usage of the Statistics server

Even though the statistics server can also run into oom errors, it should not consume a large share of the available memory. The statistics server is supposed to have a much smaller allocation limit compared to the index server. This following two configuration parameters are relevant:

statisticsserver.ini ->

memory manager

allocationlimit

minallocationlimit

The allocation limit of the statisticsserver is either a percentage of the availably RAM or just the value of minallocationlimit, depending on what is the bigger value. In case of oom errors that indicate that the statisticsserver has reached its process allocation limit, it can make sense to increase the allocationlimit to 10% or 15% to have at least a workaround for the time being. However, further analysis regarding the heap memory usage has to be conducted (see above). In the oom trace file, such a situation would look like this:

[3] PID=23840, SId=320543005, compactors active, alive, process name: hdbstatisticsse

AB=6755876864b (6.29gb), U=7135415505b (6.64gb), FSL=0b, PAL=6772669235b (6.30gb), TPAL=6772669235b (6.30gb), W=100

AB, PAL and TPAL are on the same values. Also in this case, further investigation regarding the involved pools is necessary, either using the information contained in the trace files or by using the following SQL statement:

-----------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------------------------------------------------

For further information on memory issues with the statistics server please refer to the SAP note 1929538 - HANA Statistics Server - Out of Memory.

SAP BASIS MADE EASY

Pages

Search This Blog