The benchmark Sensex rose over 95 points in early trade on Thursday.
Positive comments from the Reserve Bank Governor Raghuram Rajan that India will see limited impact of the debt crisis in Greece as it has little direct exposure to the European nation also supported the overall trade.
Opposition from business groups comes as Arun Jaitley wants to push through GST Bill calling it India's biggest tax reform since independence.
The finance ministry is working on a comprehensive package to help state-run banks, which are saddled with huge bad loans, said Jayant Sinha.
The Indian rupee has opened flat at 63.65 per dollar on Wednesday against previous day's closing value of 63.64 a dollar.
The Sensex is up 61.79 points at 27842.62, and the Nifty is up 7.75 points at 8376.25.
The rupee depreciated 20 paise to close at 63.84 in Monday's trade due to the looming debt default crisis in Greece.
Also, the NSE Nifty was up 34.65 points, or 0.42 per cent, at 8,353.05 in early trade.
Raghuram Rajan had last week said he expected that India's economy would be able to withstand any impact from the crisis in Greece thanks in part to its foreign exchange reserves
As per the proposal, Value Added Tax, which is flat 20% as of now, can vary from 12.5 to 30% on all goods, including liquor, CNG, petrol and diesel.
Shares of Bharat Forge plunged 4.03%, Tata Motors was down 2.07%, Havells India went down by 1.66% on BSE.
Indian economy, which is little more than $2 trillion, recorded a growth rate of 7.3% in 2014-15.
Terming the situation as dynamic and evolving, Mehrishi said, the crisis may have an indirect impact on India by way of its outcome on the European currency euro.
The Sensex was down 166.69 points or 0.6 per cent at 27645.15, and the Nifty slipped 54.40 points or 0.6 per cent at 8326.70.
The rupee had lost 2 paise to close at 63.64 in a range-bound trade on month-end demand for the greenback from importers despite its weakness overseas.
Rajan had asked central banks across the world to revisit "rules of the game" to find a solution, as he warned of problems similar to the Great Depression of 1930s emerging again.
Lower opening in the domestic equity market, weighed on the rupee
As many as 86.87 crore pieces of Rs 100, 56.19 crore pieces of Rs 500 and 21.75 crore pieces of Rs 1,000 were shredded.
All the banknotes in the denomination of Rs 100 issued by the RBI in the past will continue to be legal tender, it said.
The more-than-$100 billion Employees' Provident Fund Organisation (EPFO) intends to place an initial 1 per cent of its investments in exchange traded funds, increasing to 5 per cent of the annual total in equity products.
The market on Thursday continued its upward journey with the benchmark BSE Sensex rebounding 166 points to 27,895.97 on buying in capital goods, realty and banking shares.
| June 25, 2015, 8:22 am IST
Seeking to send a stern message to chronic evaders, the Income Tax department plans to take stringent action against them to ensure that they are prosecuted.
| June 24, 2015, 10:48 am IST
India is among the most cash-intensive economies in the world, with a cash-to-GDP ratio of 12 percent, almost four times that of markets such as Brazil and Mexico