Vertex failure while joining 2 big tables in hive - join

Question

I have 2 tables in hive. Table A has 300M rows and Table B has 26M rows.
I am joining Table A and Table B on 3 columns col1,col2,col3.
Below is the query I am using
create temporary table AB_TEMP AS
select A.col1,A.col2,A.col3,A.col4,A.col5
from A
join B
on A.col1=B.col1 and A.col2=B.col2 and A.col3=B.col3;
I am getting an error called vertex failure every time I run this query.
What to do to overcome this issue?
Below is the error that I am getting
Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1617665530644_1398582_10_01, diagnostics=[Task failed, taskId=task_1617665530644_1398582_10_01_000147, diagnostics=[TaskAttempt 0 failed, info=[AttemptID:attempt_1617665530644_1398582_10_01_000147_0 Timed out after 300 secs], TaskAttempt 1 failed, info=[AttemptID:attempt_1617665530644_1398582_10_01_000147_1 Timed out after 300 secs], TaskAttempt 2 failed, info=[AttemptID:attempt_1617665530644_1398582_10_01_000147_2 Timed out after 300 secs], TaskAttempt 3 failed, info=[Container container_e42_1617665530644_1398582_01_002060 timed out]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:220, Vertex vertex_1617665530644_1398582_10_01 [Map 1] killed/failed due to:OWN_TASK_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1617665530644_1398582_10_01, diagnostics=[Task failed, taskId=task_1617665530644_1398582_10_01_000147, diagnostics=[TaskAttempt 0 failed, info=[AttemptID:attempt_1617665530644_1398582_10_01_000147_0 Timed out after 300 secs], TaskAttempt 1 failed, info=[AttemptID:attempt_1617665530644_1398582_10_01_000147_1 Timed out after 300 secs], TaskAttempt 2 failed, info=[AttemptID:attempt_1617665530644_1398582_10_01_000147_2 Timed out after 300 secs], TaskAttempt 3 failed, info=[Container container_e42_1617665530644_1398582_01_002060 timed out]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:220, Vertex vertex_1617665530644_1398582_10_01 [Map 1] killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0

Answer 1

Don't execute this query on tez. We can complete this in Map Reduce.
set hive.execution.engine=mr;
set hive.auto.convert.join=false;
set mapreduce.map.memory.mb=2048;
set mapreduce.reduce.memory.mb=4096;
After setting all the above mentioned parameters, you can run the code and it executes fine

Answer 2

Memory settings for Tez (figures are just an example):
--For AM
set tez.am.resource.memory.mb=8192;
set tez.am.java.opts=-Xmx6144m;
--Mapper and Reducer
set tez.reduce.memory.mb=6144;
set hive.tez.container.size=9216;
set hive.tez.java.opts=-Xmx6144m;